Azure Databricks Data Engineer (PySpark)

Job overview

The Azure Databricks Data Engineer (PySpark) role is onsite in Dallas, TX or Atlanta, GA, five days onsite; compensation is not specified because the posting’s pay figures are redacted. The role leads migration of enterprise data integration workloads from Informatica to Azure Databricks and supports the supply chain data ecosystem.

What you'll do

• Lead migration of data pipelines, workflows, and integration patterns from Informatica to Azure Databricks
• assess existing Informatica assets and define target architecture and phased plans
• translate PowerCenter mappings into PySpark pipelines
• assess Oracle procedures and related logic for migration or refactoring
• guide design, engineering standards, testing, deployment, and production readiness
• align stakeholders, establish migration success criteria, manage risks, guide cutover and optimization, and mentor engineers.

What we're looking for

Skills & competencies

azure databricks

data engineer

pyspark

dallas tx

atlanta ga

onsite

informatica migration

oracle

unity catalog

delta live tables

adls gen2

supply chain data

Work arrangement

• Weekend coverage required

Benefits & perks

• Medical, vision, dental, life, and disability insurance
• paid time off including holidays, parental leave, and sick leave as required by law.

Why this role

The posting emphasizes Azure Databricks Runtime 14.4 LTS, Unity Catalog, Delta Live Tables, ADLS Gen2, PySpark, and supply chain data products.

About the employer

Yantran LLC is hiring for this role. Industry: Computer Systems Design Services. Sector: 54.