Software Engineer Expert, AI Output Evaluation

Job overview

The Software Engineer Expert, AI Output Evaluation role is fully remote; the posting describes remote work without a narrower geographic restriction. Compensation is $100–$150 per hour. Mercor connects technical talent with AI research labs. The role applies software engineering expertise to evaluate AI-generated artifacts, identify errors, and provide structured feedback that improves model outputs. Work is independent and asynchronous, with deadlines guiding the evaluation and feedback process.

What you'll do

• Evaluate AI-generated artifacts for usability in software engineering
• identify factual, aesthetic, and presentation errors in slides, spreadsheets, and documents
• provide structured written feedback
• grade outputs using subject-matter expertise
• work independently and asynchronously to meet deadlines.

What we're looking for

Skills & competencies

software engineer expert

remote

mercor

ai evaluation

software engineering

ai-generated artifacts

quality review

written feedback

slides

spreadsheets

documents

$100–$150/hour

5+ years experience

Work arrangement

• Weekend coverage required

Why this role

The posting describes the position as contract work and requires at least five years of relevant professional software engineering experience at a top firm in the United States, United Kingdom, Canada, Australia, or New Zealand.

About the employer

Mercor is hiring for this role. Industry: Custom Computer Programming Services. Sector: 54.