Shop App Agent Annotator, Remote

Job overview

The Shop App Agent Annotator role is remote, with the posting specifying approximately five hours per week. Compensation is $40–$50 per hour. Mercor connects creative and technical talent with leading AI research labs. The annotator evaluates shopper and agent conversations, identifies the turn receiving negative feedback, classifies the issue using a taxonomy, and writes concise explanations. Independent, asynchronous work helps maintain consistent evaluations.

What you'll do

• Evaluate shopper and agent conversations, including tool calls and outcomes
• identify the turn receiving a thumbs-down
• assign primary and secondary issue tags
• write concise comments explaining shopper intent, agent actions, and tagging rationale
• work independently and asynchronously.

What we're looking for

Skills & competencies

shop app agent annotator

remote

mercor

shop app

conversation evaluation

ai agent

annotation

taxonomy

e-commerce

tool calls

asynchronous work

$40–$50/hr

Work arrangement

• Weekend coverage required

Why this role

Approximately five hours per week; remote; structured-trace reading and consistent taxonomy application are required capabilities.

About the employer

Mercor is hiring for this role. Industry: All Other Professional, Scientific, and Technical Services. Sector: 54.