Data Science Expert — AI Evaluation

Job overview

The Data Science Expert — AI Evaluation role is remote; the posting does not specify a geographic scope. Compensation is stated as $120–$170 per hour. Mercor connects technical and creative talent with leading AI research labs. The expert creates grading criteria for data science work and evaluates AI-generated and human work samples with evidence-based written justifications. The work supports consistent, reproducible assessments and contributes to improving AI model performance.

What you'll do

• Design task-specific grading criteria for data science analyses, models, dashboards, and experiment readouts
• score AI-generated and human work samples with detailed written justifications
• apply consistent, evidence-based judgment
• incorporate senior reviewer feedback and iterate
• work independently and asynchronously to meet deadlines and improve AI model performance.

What we're looking for

Skills & competencies

data science expert

ai evaluation

data science

ai model performance

sql

python

experiment design

a/b testing

remote

mercor

$120–$170/hr

asynchronous work

Work arrangement

• Weekend coverage required

Why this role

The posting calls for five or more years of professional data science experience and experience in business operations, product, or growth data science at technology companies.

About the employer

Mercor is hiring for this role. Industry: All Other Professional, Scientific, and Technical Services. Sector: 54.