Title: Data Architect / Principal Data Engineer II
Location: Onsite – Farmington Hills – MI
Job Summary
We are seeking a skilled Data Engineer with 5+ years of experience in designing, developing and maintaining scalable data pipelines and enterprise data solutions. The ideal candidate should have strong proficiency in Python, SQL, ETL/ELT development, cloud technologies, and data integration, along with an understanding of modern AI technologies and data engineering architecture.Â
Key Responsibilities
-
Design, develop and maintain scalable ETL/ELT pipelines using Python, SQL, Pandas and Pyspark to extract, transform and integrate structured and unstructured data.Â
-
Build and manage AWS-based data pipelines using EC2 and S3, integrating data from SQL Server, Snowflake, FileNet and other enterprise data sources.Â
-
Develop data extraction and processing workflows using Amazon Textract, PostgreSQL, pgvector, vector embeddings, and Retrieval-Augmented Generation (RAG) for AI-powered applications.Â
-
Write and optimize complex SQL queries, data transformation logic, and data models to support efficient data processing, storage and analytics.Â
-
Implement data quality checks, validation rules, reconciliation processes, and automated monitoring to ensure data accuracy, reliability, and consistency.Â
-
Develop and maintain analytical datasets, Power BI dashboards, KPIs and KRIs to support business intelligence and operational reporting.Â
-
Collaborate with cross-functional teams to design scalable data architectures, automate workflows, and integrate data engineering solutions with enterprise applications.Â
-
Apply software engineering best practices, including version control, code optimization, documentation, and workflow orchestration using Git, Apache Airflow, and related tools.Â
Required Qualifications
-
Bachelor’s Degree or master’s in computer science engineering, Information Technology, Business Analytics or a related technical field.Â
-
3+ years of professional experience in Data Engineering, Software Development, or related technical roles.Â
-
Strong proficiency in Python, SQL and ETL/ELT pipeline development.Â
-
Experience working with AWS services, particularly EC2 and S3.Â
-
Hands-on experience with relational databases and cloud data warehouses such as SQL Server, MySQL and PostgreSQL and Snowflake.Â
-
Understanding data modeling, data warehousing, data quality, and pipeline orchestration.Â
-
Familiarity with Generative AI technologies, including AWS Bedrock, Lang Chain, Retrieval- Augmented Generation (RAG), Model Context Protocol (MCP), and Agent-to-Agent (A2A) communication protocol.Â
Preferred QualificationsÂ
-
Experience with Apache Spark, PySpark, Databricks, or Apache AirflowÂ
-
Familiarity with Amazon Textract, PostgreSQL pgvector, vector databases, and semantic search.Â
-
Experience with Power BI, DAX, Power Platform and enterprise reporting solutions.Â
-
Knowledge of Terraform, Git, REST APIs, and CI/CD practices.Â
-
Exposure to building AI-powered data pipelines, LLM integrations, or intelligent document processing solutions.Â
-
AWS or other cloud platform certificationsÂ
Technical Skills
-
Programming: Python, SQL, Pandas, NumPy, PySpark, Spark SQL
-
Cloud: AWS EC2, S3, IAM, Lambda, Textract, ECS, ECR
-
Databases: SQL Server, MySQL, PostgreSQL, pgvector, Snowflake
-
Data Engineering: ETL/ELT, Data Modeling, Data Warehousing, Data Integration, Data Quality, Apache Spark, Airflow
-
AI Technologies: AWS Bedrock, LangChain, RAG, LLMs, MCP, A2A, Vector Embeddings
-
Analytics and DevOps: Power BI, Git, Terraform, REST APIs, CI/CD
Must-Have Technical Skills
-
Business Intellgience – Data Engineering
-
Python
-
S3
-
SQL
Why work at OpTech?Â
OpTech is a woman-owned company that values your ideas, encourages your growth, and always has your back. When you work at OpTech, not only do you get health and dental benefits, but you also have training opportunities, flexible/remote work options, growth opportunities, 401K and competitive pay. Apply today!Â
By submitting your application, you acknowledge that recruiting technologies, including AI-assisted tools, may be used to support candidate evaluation, sourcing, matching, and communications.Â
OpTech is an Equal Opportunity Employer (EOE), all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Â