Medical Evaluation Specialist – Remote

Job overview

The Medical Evaluation Specialist – Remote role is remote; the listing identifies San Jose, CA, but does not specify a geographic limit for remote work. Compensation is described as $40–$90 per hour in the listing, while the posting says contributors are paid per task that meets project specifications and quality standards. YO AI Labs is working on evaluation and improvement of next-generation AI systems. The specialist uses medical knowledge and research skills to create and validate challenging clinical questions and answers, then evaluates AI-generated responses against evidence. This work helps establish rigorous benchmarks for clinical reasoning, accuracy, and evidence use.

What you'll do

• Create high-difficulty medical question-and-answer pairs
• research and verify answers using primary literature, guidelines, systematic reviews, and authoritative references
• document rationales and citations
• evaluate AI responses for accuracy, completeness, reasoning quality, and evidence adherence
• refine overly straightforward questions
• review for ambiguity and errors
• incorporate reviewer feedback and contribute to medical AI benchmarks.

What we're looking for

Skills & competencies

medical evaluation specialist

remote

medical ai

clinical reasoning

medical research

evidence synthesis

question development

ai evaluation

san jose ca

yo ai labs

$40–$90/hour

Work arrangement

• Weekend coverage required

Why this role

No prior AI experience is required; compensation is output-based and paid per qualifying task. Medical students, residents, physicians, and qualified biomedical professionals are among the intended contributors.

About the employer

YO AI Labs is hiring for this role. Industry: Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology). Sector: 54.