Back to search

Psychometrics Expert

Mercor · San Francisco, CA · AI research lab evaluation work

Compensation

$50 – $63 /hr

Employment type

Full-time

Work setting

On-site

Location

San Francisco, CA

Schedule

Day shift

Posted

Apply for this job

You'll be redirected to the employer's application page.

Job overview

The Psychometrics Expert role is fully remote, with a commitment of 10+ hours per week. Compensation is $50–$63 per hour. The role supports Mercor’s work connecting technical and creative talent with AI research labs. The specialist creates and reviews psychology questions and solutions to assess deep conceptual understanding and guide AI model training. Clear, rigorous questions and verification feedback help improve the quality of model evaluation materials.

What you'll do

  • Author original psychology questions that test conceptual understanding
  • ensure questions are unambiguous, self-contained, and precisely defined
  • rate question difficulty as Medium, Hard, or Expert
  • provide one correct answer and nine plausible but incorrect alternatives
  • write step-by-step solutions in markdown
  • supply 1–5 academic references per question
  • flag clarity, completeness, precision, or solvability issues in verification tasks and justify edits.

What we're looking for

Skills & competencies
psychometrics expert
mercor
remote
$50–$63/hr
10+ hours per week
applied psychology
question authoring
ai model training
research references
psychology theory
assessment design
remote work
Work arrangement
  • Weekend coverage required

Why this role

Requires a PhD, PsyD, or doctoral candidacy in psychology or a closely related field; a master’s degree may be considered for exceptional depth in a subdomain. Clinical licensure or psychology research publications are preferred.

About the employer

Mercor is hiring for this role. Industry: Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology). Sector: 54.

Additional details

Industry sector
54
Industry
Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology)
Occupation code
19-3039.00
Apply for this job

You'll be redirected to the employer's application page.

Browse more jobs

Listing ID: 06aad6c3-f318-4144-97e9-feaa95d998b5

    Psychometrics Expert at Mercor | CollabWORK