Software Engineer, Inference

Job overview

The Software Engineer, Inference role is hybrid in Bellevue, WA. Compensation is $120,000 to $160,000 per year. CoreWeave provides cloud infrastructure for AI and high-performance GPU workloads, including real-time inference. The engineer owns a production model-serving service from design through operations, improving reliability and performance for inference workloads. The work supports the Inference team's platform goals through feature delivery, observability, operational improvements, and collaboration with runtime, scheduling, and networking peers.

What you'll do

• Own a model-serving service through design, implementation, testing, deployment, and operations
• improve dashboards, alerts, and traces
• automate runbook steps
• tune latency and throughput through micro-batching, concurrency, and caching
• participate in on-call and lead post-incident action items
• review pull requests and contribute design feedback.

What we're looking for

Skills & competencies

software engineer

inference

full-time

hybrid

bellevue wa

coreweave

model serving

python

go

kubernetes

gpu inference

on-call

$120k–$160k per year

Work arrangement

• Weekend coverage required

Benefits & perks

• Employer-paid medical, dental, and vision
• life insurance
• supplemental life insurance
• short- and long-term disability
• FSA and HSA
• tuition reimbursement
• employee stock purchase program
• mental wellness benefits
• family-forming support
• paid parental leave
• childcare support
• 401(k) match
• flexible PTO
• catered lunch at office and data center locations.

Why this role

Production ownership of an inference service; work on AI cloud infrastructure and model serving.

About the employer

CoreWeave is hiring for this role. Industry: Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services. Sector: 51.