Medical Evaluation Specialist — Remote

Job overview

The Medical Evaluation Specialist role is remote, and compensation is $40–$90 per hour as listed; the posting states that pay is output-based per task meeting project specifications and quality standards. YO AI Labs is seeking medical and biomedical expertise to evaluate and improve next-generation AI systems. The specialist develops and validates challenging medical questions and answers, researches evidence, documents rationales and citations, and evaluates AI-generated responses for clinical accuracy and reasoning quality. The work contributes to rigorous benchmarks for medical AI evaluation.

What you'll do

• Create and validate high-difficulty medical question-and-answer pairs
• research and verify answers using medical literature and guidelines
• document rationales and citations
• evaluate AI responses for accuracy, completeness, reasoning, and evidence alignment
• refine questions
• review deliverables for ambiguity and errors
• incorporate reviewer feedback.

What we're looking for

Skills & competencies

medical evaluation specialist

remote

clinical reasoning

medical question development

evidence synthesis

medical literature review

ai evaluation

yo ai labs

output-based compensation

$40–$90/hr

medical training

Work arrangement

• Weekend coverage required

Why this role

Remote contractor project; no prior AI experience is required. Selected contributors should be prepared to begin assignments within 24–48 hours after onboarding and meet minimum weekly task requirements.

About the employer

YO AI Labs is hiring for this role. Industry: Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology). Sector: 54.