Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference

Job overview

Compensation is $193,000–$261,000 per year. The Senior Software Development Engineer, AI/ML, AWS Neuron, Model Inference role is an onsite position based in Cupertino, CA. 00 - 261,500.00 USD annually, and this role supports the Annapurna Labs team within AWS, focusing on model inference enablement. This role exists to architect and implement distributed inference support for PyTorch and other frameworks. It contributes to the team's goal of maximizing performance and efficiency for large language models running on Trainium and Inferentia silicon.

What you'll do

• Design and optimize ML models for custom hardware
• build infrastructure for systematic model analysis
• implement high-performance kernels
• collaborate with customers to enable and optimize their ML models.

What we're looking for

Skills & competencies

full-time

day shift

cupertino ca

annapurna labs

senior software engineer

ai/ml

inference

pytorch

llm

optimization

$193k-$261k

Work arrangement

• Weekend coverage required

Benefits & perks

• Health insurance, 401(k) matching, paid time off, parental leave, sign-on payments, and restricted stock units (RSUs).

Why this role

Focus on distributed inference, LLM optimization, and high-performance kernel development.

About the employer

Annapurna Labs (U.S.) Inc. is hiring for this role. Industry: Custom Computer Programming Services. Sector: 54.