Senior Splunk & Observability Engineer

Location: Lafayette, Louisiana, United States; hybrid work with onsite and remote components.

Company

hirify.global delivers outsourced services and workforce solutions across North America.

What you will do

• Support enterprise-scale observability platforms in a complex AWS production environment.
• Manage Splunk Enterprise across source onboarding, ingestion, indexing, search, dashboards, alerts, retention, and recovery.
• Develop and optimize SPL queries, troubleshoot ingestion and performance issues, and support platform stability, upgrades, vulnerability remediation, and data recovery.
• Build dashboards for production monitoring, resiliency, incident response, and outage triage.
• Integrate AWS, Amazon CloudWatch, and OpenTelemetry; develop Python automation and deploy infrastructure using GitLab, GitHub, Terraform Enterprise, JSON, and CI/CD tools.
• Lead technical troubleshooting calls, coordinate incident remediation across cloud, application, security, database, and support teams, and participate in an after-hours on-call rotation.

Requirements

• 5+ years of hands-on Splunk Enterprise administration and engineering experience in large production environments.
• Strong understanding of the Splunk ecosystem, including data ingestion, forwarders, indexers, search heads, dashboards, alerts, and recovery.
• Advanced SPL query development and performance optimization skills.
• Hands-on experience deploying, configuring, upgrading, troubleshooting, and supporting Splunk on AWS.
• Strong AWS production experience with Amazon EC2, Application Load Balancer, and Amazon CloudWatch.
• Experience building complex Splunk dashboards for production monitoring, resiliency, incident triage, and operational use cases.
• Strong understanding of OpenTelemetry agents, collectors, logs, metrics, instrumentation, and Splunk integration, including experience building or maintaining agent and collector packages.
• Working knowledge of Python for automation and operational tooling.
• Experience with GitLab, Terraform Enterprise, CI/CD, GitHub, and JSON.
• Strong troubleshooting skills covering ingestion failures, data volume issues, platform outages, and data recovery.
• Experience with platform upgrades, patching, vulnerability remediation, and controlled production changes.
• Ability to lead technical troubleshooting calls, communicate clearly, and coordinate across multiple technical teams.
• Bachelor's degree in computer science, Information Systems, or a related field.

Culture & Benefits

• Hybrid onsite and remote work model.
• Permanent full-time direct-hire employment.
• After-hours on-call rotation for production incidents, upgrades, and planned changes.
• Eligible employees may receive medical, dental, vision, spending account, life insurance, and voluntary plan coverage.
• Participation in a 401(k) plan is available to eligible employees.