Research Scientist

Job overview

The Research Scientist role is in person in San Francisco, CA. Compensation is $200,000–$500,000 per year, plus meaningful equity as described in the posting. Idler is a data research lab building evaluations and environments used by frontier labs to measure and train models. The scientist measures and improves how models learn from tasks, validates data quality with research customers, and develops datasets and data products. The work aims to increase the learning signal produced by the lab’s tasks and support scalable model training and evaluation.

What you'll do

• Work with frontier-lab researchers on post-training recipes and data-quality measurement
• run the in-house post-training stack to measure model lift
• develop data products and task distributions
• create agents to analyze environments and trajectories
• assess external data for refinement
• build systems for ingesting and evaluating data
• develop techniques for mining data for signal.

What we're looking for

Skills & competencies

research scientist

san francisco ca

idler

model training

reinforcement learning

post-training

llm

data quality

ai evaluation

research and development

relocation assistance

Work arrangement

• Weekend coverage required

Benefits & perks

• Free office meals
• healthcare
• 401(k)
• 15 days of paid time off per year
• relocation assistance.

Why this role

The posting seeks 1+ years of production reinforcement learning experience at a frontier lab and an end-to-end LLM post-training track record. Benefits include office meals, healthcare, 401(k), 15 days of PTO, and relocation assistance.

About the employer

Idler is hiring for this role. Industry: Research and Development in the Physical, Engineering, and Life Sciences (except Nanotechnology and Biotechnology). Sector: 54.