Operations Manager, AI Systems Evaluator

Job overview

The Operations Manager, AI Systems Evaluator role is remote; the posting does not specify a geographic scope. Compensation is $70–$110 per hour, with a 20+ hour weekly commitment for a four-to-six-week engagement. Mercor connects creative and technical talent with leading AI research labs. The role applies operations-management expertise to evaluate AI-generated plans, schedules, reviews, and responses for quality, accuracy, financial rigor, and feasibility. The evaluator reviews operational scenarios and provides expert feedback independently and asynchronously to help improve AI systems.

What you'll do

• Evaluate AI-generated operational plans, staff schedules, and performance reviews
• compare AI-generated responses for operational soundness, financial rigor, and cross-department feasibility
• review budgeting, staffing, and workflow scenarios and provide expert feedback
• apply experience directing multi-department operations, staffing, and financial oversight
• work independently and asynchronously to meet deadlines.

What we're looking for

Skills & competencies

operations manager

ai systems evaluator

operations management

ai-generated plans

staffing

budgeting

workflow coordination

remote

mercor

$70–$110/hr

20+ hours/week

4–6 weeks

asynchronous work

Work arrangement

• Weekend coverage required

Benefits & perks

• Temporary employee benefits package may apply after 60 days of employment
• the posting states that military fellows and part-time employees are not eligible for benefits.

Why this role

The engagement lasts four to six weeks, requires 20+ hours per week, and uses task-based payment for the first task before hourly payment for the remainder of the project.

About the employer

Mercor is hiring for this role. Industry: Employment Placement Agencies. Sector: 56.