AI Developer Trace Task Auditor — Remote

Job overview

The AI Developer Trace Task Auditor is a remote contract role paying $70–$90 per hour. Mercor connects technical and creative talent with AI research labs and is headquartered in San Francisco. The auditor evaluates AI-assisted software-development traces for correctness, workflow quality, and reasoning, then provides rubric-based feedback. The work helps research teams improve model training data and evaluate AI model performance.

What you'll do

• Evaluate AI-assisted software-development traces and end-to-end coding sessions
• assess correctness, workflow soundness, reasoning, and alignment with best practices
• provide written rubric-based feedback
• collaborate with AI research teams on training-data consistency and relevance
• work independently and asynchronously to meet deadlines.

What we're looking for

Skills & competencies

remote

ai developer trace task auditor

software development

ai-assisted coding

code review

trace evaluation

model training

rubric-based feedback

ai research

$70–$90/hour

asynchronous work

Work arrangement

• Weekend coverage required

Why this role

The posting requires at least three years of professional software-development experience and hands-on experience with AI-assisted coding tools and agentic or spec-driven workflows.

About the employer

Mercor is hiring for this role. Industry: All Other Professional, Scientific, and Technical Services. Sector: 54.