Linguist – AI Rater Guidelines Expert

Job overview

The Linguist – AI Rater Guidelines Expert role is listed as fully remote, with the listing location in San Francisco, CA. Compensation is $45–$65 per hour. Mercor connects creative and technical talent with leading AI research labs. The role turns ambiguous program requirements into clear, consistent instructions and rubrics so human raters can evaluate work across multiple subject areas with fewer gaps or contradictions.

What you'll do

• Guide research and program teams in converting requirements into rater-ready instructions
• design clear rating guidelines and rubrics, including edge cases
• review drafts for ambiguity, contradictions, and coverage gaps
• translate specifications in finance, retail, insurance, legal, and sports into domain-specific instructions
• collaborate with subject matter experts and program leads to maintain consistency and accuracy.

What we're looking for

Skills & competencies

linguistics

ai rater guidelines

instructional design

technical writing

rubrics

generative ai

rlhf

research programs

mercor

san francisco ca

$45–$65/hr

Work arrangement

• Weekend coverage required

Why this role

Combines linguistics or instructional design with direct experience writing guidelines for human raters in a generative AI or RLHF context.

About the employer

Mercor is hiring for this role. Industry: All Other Professional, Scientific, and Technical Services. Sector: 54.