AI Engineer – Model Training, Inference & Infrastructure

Job overview

The AI Engineer – Model Training, Inference & Infrastructure is a full-time, onsite role. The posting lists San Jose, CA; Austin, TX; or Taiwan as work locations, while the listing location is Bellevue, WA. Compensation is not specified. The client is developing design automation for the semiconductor industry, with a mission to enable engineering organizations to build self-improving agentic design workforces. The engineer owns model training, inference and infrastructure that power agentic design workflows. The role takes models from data pipelines and training through evaluation and production serving, improving agent capability, reliability, speed and cost efficiency for real semiconductor design environments.

What you'll do

• Train, post-train and fine-tune large language models
• build data pipelines for training and evaluation
• operate distributed training on multi-node GPU clusters
• build high-throughput, low-latency inference systems
• optimize custom GPU kernels and end-to-end performance
• develop model infrastructure for orchestration, scheduling, checkpointing, observability and cost tracking
• build evaluation systems and reward models
• design self-improving learning loops
• integrate models with agent runtimes and production serving
• collaborate with research, product, platform and solutions teams across San Jose, Austin and Taiwan.

What we're looking for

Skills & competencies

ai engineer

model training

inference

infrastructure

san jose ca

austin tx

taiwan

gpu computing

large language models

distributed training

semiconductor design

agentic design automation

Work arrangement

• Weekend coverage required

Why this role

Requires a PhD or master’s degree in a related field or equivalent practical experience, strong Python and C++ or Rust skills, and deep experience with PyTorch or JAX. Relevant experience includes distributed model training, inference, GPU programming, ML infrastructure and automated evaluation. The posting describes a small, highly technical team and deployment with leading chip-design organizations.

About the employer

International Recruiting LLC is hiring for this role. Industry: Engineering Services. Sector: 54.