Technical Expert, AI Model Benchmarking

Job overview

The Technical Expert, AI Model Benchmarking role is listed in Florida City, FL; the posting does not specify a work arrangement. Compensation is not specified. The enterprise client helps innovative companies improve AI models through human feedback. The project seeks experts to create difficult, field-specific problems that AI agents attempt to solve in a Linux terminal. Contributors design benchmark tasks that reveal where current models fail, rather than performing annotation.

What you'll do

• Create a genuinely difficult expert-level problem from the contributor’s technical field and turn it into a task an AI must solve from scratch in a Linux terminal
• contribute to an ongoing project lasting at least seven weeks
• complete an onboarding process of approximately 90 minutes.

What we're looking for

Skills & competencies

technical expert

ai benchmarking

ai models

expert problem design

linux terminal

coding

machine learning

systems

security

hardware

florida city fl

master’s degree or higher

10+ years experience

Work arrangement

• Weekend coverage required

Why this role

Applicants need a master’s degree or higher, 10+ years of professional experience in a technical domain, and at least one academic or professional publication. Domains in demand include coding, machine learning, systems, security, and hardware.

About the employer

Lifted, an Upwork Company™ is hiring for this role. Industry: Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services. Sector: 51.