Data Pipeline Engineer

Job overview

The Data Pipeline Engineer role is onsite in Sunnyvale, CA. Compensation is $100 per hour. The role supports development of a unified data platform for multimedia data and a federated data ecosystem. The engineer designs schemas and scalable, monitored pipelines for image and video data, while improving database performance, data quality visibility, and access to connected datasets. The work also includes full-stack components and APIs that bring data from multiple sources into a consumer-facing interface, with security and privacy compliance across platforms and studies.

What you'll do

• Design standardized schemas across heterogeneous storage platforms
• build and maintain scalable, monitored image and video data pipelines
• create and maintain SQL, vector, and unstructured data schemas and optimize queries and storage
• develop dashboards for ingestion progress and metadata quality
• support a federated data ecosystem
• build application and dashboard components, APIs, and integrations
• ensure data handling meets security and privacy requirements. Agentic AI prototyping is described as a stretch/preferred activity.

What we're looking for

Skills & competencies

data pipeline engineer

sunnyvale ca

mindlance

python

sql

multimedia data

data warehousing

cloud pipelines

spark

airflow

snowflake

$100/hr

onsite

Work arrangement

• Weekend coverage required

Why this role

Requires 8 years of software development experience and 5 years each in data warehouse/analytics solutions and cloud-based data processing pipelines; agentic AI experience is preferred.

About the employer

Mindlance is hiring for this role. Industry: Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services. Sector: 51.