General Clinician (MD/DO) – AI System Evaluator

Job overview

The General Clinician (MD/DO) – AI System Evaluator role is fully remote. Compensation is $150 per hour, and the posting requires a minimum of 20 hours per week. Mercor connects clinical and technical talent with AI research labs. The clinician evaluates AI-generated clinical content for accuracy, safety, completeness, and appropriate escalation. The role develops grading criteria and guidelines, documents clinical reasoning, and creates challenging questions to help assess and improve model performance.

What you'll do

• Develop checkable grading criteria for clinical questions
• evaluate clinical dialogues for accuracy, safety, completeness, and escalation advice
• annotate clinical reasoning and case work-throughs
• flag hallucinated findings, dangerous omissions, and unsafe advice
• author guidelines for edge cases and standards of care
• write difficult-case questions to probe model reasoning.

What we're looking for

Skills & competencies

general clinician

md

do

ai system evaluator

mercor

remote

$150/hr

clinical dialogue evaluation

clinical reasoning

safety review

grading criteria

completed residency

active medical license

20 hours per week

Work arrangement

• Weekend coverage required

Why this role

Requires an MD or DO, completed residency, active unrestricted medical license in the country of practice, and at least three years of post-residency clinical experience; minimum 20 hours per week.

About the employer

Mercor is hiring for this role. Industry: All Other Professional, Scientific, and Technical Services. Sector: 54.