Customer Success Operations Evaluator — AI Trainer

Job overview

The Customer Success Operations Evaluator — AI Trainer role is remote, with compensation of $80–$120 per hour. Mercor connects creative and technical talent with leading AI research labs. The evaluator assesses AI-generated work against domain-specific quality rubrics, identifies factual and presentation errors, and provides structured feedback. These assessments help improve model performance and maintain consistency across datasets in collaboration with subject matter experts.

What you'll do

• Evaluate AI-generated artifacts against quality rubrics
• identify factual, aesthetic, and presentation errors
• provide structured written feedback to improve AI model performance
• work independently and asynchronously to meet deadlines
• collaborate with subject matter experts to support dataset consistency.

What we're looking for

Skills & competencies

customer success operations evaluator

ai trainer

ai output evaluation

quality rubrics

customer success

support operations

remote

mercor

$80–$120/hour

5+ years experience

google workspace

microsoft office

Work arrangement

• Weekend coverage required

Why this role

Requires 5+ years of customer success or support operations experience, professional or native English fluency, and strong Microsoft Office and Google Workspace proficiency, especially Slides. Advanced degree is preferred.

About the employer

Mercor is hiring for this role. Industry: All Other Professional, Scientific, and Technical Services. Sector: 54.