Data Scientist, AI Evaluation

Job overview

The Data Scientist, AI Evaluation opportunity is remote; the posting does not specify a geographic scope. Compensation is $100–$150 per hour. Mercor connects technical talent with leading AI research labs. The role evaluates data science work by creating task-specific grading criteria and assessing AI-generated or human-created deliverables. It supports quality and accuracy through evidence-based scoring, written justifications, and revisions informed by senior reviewer feedback.

What you'll do

• Design grading criteria for exploratory data analyses, statistical models, machine-learning pipelines, and technical reports
• evaluate AI-generated or human-created work against criteria
• provide written justifications for scores
• apply consistent evidence-based judgment
• incorporate senior reviewer feedback and revise submitted work.

What we're looking for

Skills & competencies

data scientist

ai evaluation

remote

mercor

$100–$150 per hour

data science

python

sql

statistical modeling

machine learning

exploratory data analysis

evaluation criteria

technical reports

Work arrangement

• Weekend coverage required

Why this role

The posting describes a Data Scientist Talent Network opportunity and lists a contract type; it requires at least one year of professional data science experience and strong Python, SQL, statistical modeling, and machine-learning skills.

About the employer

Mercor is hiring for this role. Industry: Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services. Sector: 51.