Head of AI Quality (Member of Technical Staff)

Job overview

The Head of AI Quality (Member of Technical Staff) role is onsite in San Francisco, CA, with compensation of $180,000–$280,000 per year. Plato builds simulated environments from real-world data to train specialized AI agents. This role establishes and enforces quality standards for the tasks, verifiers, and environments delivered to customers. It combines adversarial testing and automated verification engineering with leadership of the verification team, helping ensure training signals are reliable and do not reward unintended behavior.

What you'll do

• Own final sign-off on environments and datasets before delivery
• audit trajectories, tasks, and reward dynamics
• build red-team suites to test task feasibility and verifier integrity
• architect judge models, sandbox replay harnesses, and rollout forensics
• hire and direct QA engineers, domain specialists, and technical reviewers
• translate model failure modes into generator constraints.

What we're looking for

Skills & competencies

head of ai quality

member of technical staff

ai quality

reinforcement learning

automated verification

red teaming

ai agents

python

san francisco ca

plato

$180k–$280k

Work arrangement

• Weekend coverage required

Why this role

Builds Plato’s AI quality and verification systems from scratch and works on failure modes affecting frontier model post-training and agent workflows.

About the employer

Plato is hiring for this role. Industry: Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology). Sector: 54.