User Research Expert, Evaluator

Job overview

The User Research Expert, Evaluator role is remote; the posting does not specify a geographic scope. Compensation is $80–$120 per hour. Mercor connects creative and technical talent with leading AI research labs. The evaluator assesses AI-generated work products against quality rubrics and provides structured feedback to improve model outputs. The role contributes to consistent evaluation datasets by identifying errors and collaborating with subject matter experts while working independently and asynchronously.

What you'll do

• Evaluate AI-generated artifacts against domain-specific quality rubrics
• identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks
• provide structured written feedback to improve AI model outputs
• work independently and asynchronously to meet deadlines
• collaborate with subject matter experts to maintain dataset consistency and quality.

What we're looking for

Skills & competencies

user research

evaluator

customer research

feedback synthesis

ai-generated artifacts

quality rubrics

document review

spreadsheet review

slide deck review

written feedback

remote

mercor

$80–$120/hour

Work arrangement

• Weekend coverage required

Why this role

The posting specifies remote work, independent asynchronous work, and a requirement for 5+ years of relevant user/customer research and feedback-synthesis experience.

About the employer

Mercor is hiring for this role. Industry: All Other Professional, Scientific, and Technical Services. Sector: 54.