Splunk Observability Engineer

Job overview

The Splunk Observability Engineer role is onsite in Lafayette, LA, Knoxville, TN, Columbia, SC, or Birmingham, AL. Compensation is not specified. The role supports large Splunk and observability platforms in an AWS production setting for System One’s client. The engineer maintains and improves production observability systems, ensuring data ingestion, search, dashboards, alerts, retention, and recovery work reliably. The role contributes to platform stability, troubleshooting, security, and cost control while coordinating incident response across teams.

What you'll do

• Run, upgrade, and support Splunk Enterprise on AWS EC2
• manage data ingestion, indexing, search, dashboards, alerts, retention, and recovery
• write and tune SPL queries
• troubleshoot ingestion failures and outages
• restore and replay data
• reduce noise, storage use, and cost
• integrate CloudWatch and OpenTelemetry
• maintain OpenTelemetry packages
• automate with Python
• patch systems
• lead troubleshooting calls
• participate in an on-call rotation.

What we're looking for

Skills & competencies

splunk observability engineer

splunk enterprise

aws

opentelemetry

python

spl

cloudwatch

terraform

ci/cd

lafayette la

knoxville tn

columbia sc

birmingham al

on-call rotation

Work arrangement

• Weekend coverage required

Why this role

Requires U.S. citizenship, Green Card, or current H-1B status with willingness to transfer; W-2 salaried candidates only, with no third-party C2C or contractors.

About the employer

System One is hiring for this role. Industry: Custom Computer Programming Services. Sector: 54.