Senior Data Engineer / Machine Learning Platform Engineer – Databricks & GenAI

Job overview

The Senior Data Engineer / Machine Learning Platform Engineer role is onsite four days per week in either Warren, MI or Austin, TX; compensation is not specified. The role augments an internal team delivering Databricks data platforms, enterprise datasets, and GenAI-ready data products across multiple programs. The engineer builds reliable, governed lakehouse pipelines and data products that support analytics, machine-learning and generative-AI use cases. The work follows existing platform standards and enables application and ML teams to use stable, well-documented data assets.

What you'll do

• Build production Databricks pipelines using PySpark, SQL, Delta Lake, Unity Catalog, and Workflows/Jobs
• implement idempotency, testing, monitoring, and lineage
• model bronze, silver, and gold layers and data contracts
• develop ML-oriented data products including curated tables, embeddings, RAG chunking and indexing, and batch classification or enrichment
• integrate Azure services using enterprise security patterns
• partner with application and ML teams to expose stable APIs, tables, and volumes
• document data dictionaries and runbooks
• participate in code reviews and agile ceremonies.

What we're looking for

Skills & competencies

senior data engineer

machine learning platform engineer

databricks

genai

pyspark

sql

delta lake

unity catalog

warren mi

austin tx

onsite 4 days/week

rag data products

Work arrangement

• Weekend coverage required

Why this role

Requires five years of data engineering, including two years of production Databricks on Azure. The posting describes contract staff augmentation with possible conversion to full-time employment after six months.

About the employer

Expert In Recruitment Solutions is hiring for this role. Industry: Computer Systems Design Services. Sector: 54.