User Research Expert — Evaluator and AI Trainer

Job overview

The User Research Expert — Evaluator and AI Trainer role is remote; the posting does not specify a geographic restriction. Compensation is $80–$120 per hour. Mercor connects creative and technical talent with leading AI research labs. The evaluator reviews AI-generated materials against quality rubrics, identifies factual, aesthetic, and presentation issues, and provides structured feedback. This independent, asynchronous work helps improve AI model outputs and maintain consistency across datasets.

What you'll do

• Evaluate AI-generated artifacts against domain-specific quality rubrics
• identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks
• provide structured written feedback to improve model outputs
• work independently and asynchronously to meet deadlines
• collaborate with subject matter experts to support dataset consistency and quality.

What we're looking for

Skills & competencies

user research expert

evaluator

ai trainer

remote

$80–$120 per hour

ai-generated content

feedback synthesis

quality rubrics

document review

spreadsheet review

slide deck review

asynchronous work

mercor

Work arrangement

• Weekend coverage required

Why this role

Contract opportunity requiring five or more years of relevant user or customer research and feedback synthesis experience, professional or native English fluency, and strong Microsoft Office and Google Workspace skills, especially Slides. An advanced degree is preferred.

About the employer

Mercor is hiring for this role. Industry: All Other Professional, Scientific, and Technical Services. Sector: 54.