AI Application Engineer

Job overview

The AI Application Engineer role is remote, with Scottsdale, Arizona listed as the job location. Pay is $50.30 per hour. SGA describes itself as a technology and resource solutions provider focused on solving IT problems through a personal, boutique approach. This role develops and supports AI agent experiences across customer and internal workflows. It combines prompt and agent design with testing, evaluation, observability, and integration work to improve reliability, accuracy, and user experience.

What you'll do

• Design and refine AI agent logic, prompts, tools, and workflows
• run prompt experiments and A/B tests
• create test plans and evaluation frameworks
• test for accuracy, safety, hallucinations, consistency, and instruction following
• perform regression testing and track defects in Azure DevOps
• monitor agent performance and develop quality metrics
• investigate production issues
• validate API integrations, retrieval pipelines, and agent workflows
• support CI/CD release validation
• maintain documentation and participate in Agile ceremonies.

What we're looking for

Skills & competencies

ai application engineer

remote

scottsdale az

sga inc.

$50.30/hr

generative ai

llms

prompt engineering

ai agent design

ai quality assurance

azure devops

python

sql

rest apis

Work arrangement

• Weekend coverage required

Why this role

Remote role combining generative AI prompt engineering, agent quality assurance, evaluation, and observability.

About the employer

SGA Inc. is hiring for this role. Industry: Custom Computer Programming Services. Sector: 54.