Data Engineer - Capital Markets

Job overview

The Data Engineer - Capital Markets role is an onsite position based in New York, NY. Compensation is not specified in the posting, and this role supports the enterprise data Lakehouse infrastructure team at SMBC. This role exists to design, optimize, and maintain high-performance data pipelines and analytics environments. It contributes to the organization's goals by ensuring seamless integration between Databricks and AWS services to support real-time financial trading data consumption.

What you'll do

• Design and implement data pipelines using Databricks Medallion Architecture.
• Develop and orchestrate complex data workflows.
• Standardize deployment of Databricks assets using CI/CD tools.
• Integrate Databricks with AWS services like S3 and Glue.
• Optimize Spark clusters and Delta Lake storage.
• Implement data governance and security controls.

What we're looking for

Skills & competencies

full-time

data engineer

databricks

aws

new york ny

smbc

financial services

onsite

data pipelines

spark

sql

python

ci/cd

Work arrangement

• Weekend coverage required

Benefits & perks

• Competitive portfolio of benefits including discretionary incentive awards.

Why this role

Requires 4+ years of Databricks experience and 3+ years in AWS cloud environments.

About the employer

SMBC is hiring for this role. Industry: Financial Transactions Processing, Reserve, and Clearinghouse Activities. Sector: 52.