Back to search

Data Engineer – AI Model Evaluation

Mercor · San Francisco, CA · AI Model Evaluation

Compensation

$80/hour

Employment type

Full-time

Work setting

On-site

Location

San Francisco, CA

Schedule

Day shift

Posted

Apply for this job

You'll be redirected to the employer's application page.

Job overview

The Data Engineer – AI Model Evaluation role is remote; the posting does not specify a geographic scope. Compensation is stated as $80 per hour, with additional compensation of $400 per accepted task. Mercor connects creative and technical talent with leading AI research labs. The engineer uses AI coding agents to complete and evaluate data engineering tasks and reviews model-generated implementations. The work applies professional engineering judgment to identify defects and assess model performance across data infrastructure scenarios.

What you'll do

  • Use frontier AI coding agents to complete and evaluate complex data engineering tasks
  • review model-generated ETL pipelines, data warehouses, analytics platforms, and distributed data systems
  • identify bugs, edge cases, scalability issues, and failure modes
  • compare outputs from multiple models and assess strengths and weaknesses
  • apply engineering judgment to realistic data engineering scenarios.

What we're looking for

Skills & competencies
data engineer
ai model evaluation
remote
mercor
ai coding agents
etl pipelines
data warehouses
distributed data systems
model evaluation
$80/hour
$400 per accepted task
contract
Work arrangement
  • Weekend coverage required

Why this role

The posting describes the opportunity as contract work and states compensation is tied to accepted work; requires 2+ years of professional data engineering experience and regular use of AI coding agents.

About the employer

Mercor is hiring for this role. Industry: Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services. Sector: 51.

Additional details

Industry sector
51
Industry
Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services
Occupation code
15-1243.00
Apply for this job

You'll be redirected to the employer's application page.

Browse more jobs

Listing ID: 29bfc0e5-c43d-4394-9055-3210ed961d6a

    Data Engineer – AI Model Evaluation at Mercor | CollabWORK