Senior DevOps Engineer (Big Data)

TL;DR

Senior DevOps Engineer (Big Data/Infrastructure): Designing, building, and optimizing infrastructure for big data tools and orchestration platforms with an accent on reliability, security, and scalability. Focus on implementing observability stacks, automating infrastructure via IaC, and supporting high-throughput data processing and AI/ML workloads.

Location: San Francisco, CA (options for working from home)

Salary: $130,000 – $196,500

Company

hirify.global is a data collaboration platform focused on consumer privacy, data ethics, and foundational identity.

What you will do

• Design and optimize infrastructure for big data tools (Kafka, Redpanda) and orchestration (Airflow, Temporal) on Kubernetes and cloud.
• Implement observability tooling for metrics, logs, and traces to reduce MTTR and improve system resilience.
• Automate infrastructure provisioning using Terraform and maintain CI/CD pipelines (GitHub Actions, Jenkins, GitLab CI).
• Lead collaboration with security and application stakeholders to deliver secure Big Data infrastructure.
• Manage on-call responsibilities, triage incidents, and ensure systems meet defined SLAs.
• Mentor engineers on DevOps best practices and evaluate emerging data technologies via POCs.

Requirements

• 7+ years of experience in DevOps, SRE, or infrastructure engineering supporting production systems.
• Significant hands-on experience with major cloud providers (AWS, GCP, or Azure).
• Strong proficiency with Infrastructure as Code (Terraform) and CI/CD tools.
• Solid background in Linux, containers, and orchestration platforms (Kubernetes, ECS).
• Proficiency in at least one automation language such as Python, Go, or Bash.
• Ability to participate in an on-call rotation and lead incident response.

Nice to have

• 3+ years of software development experience in Python, Go, Java, or Scala.
• Experience using AI tools, NLP, and agent creation.
• Exposure to security and compliance considerations for data platforms (access control, encryption, governance).

Culture & Benefits

• Comprehensive benefits package including medical, dental, vision, life, and disability insurance.
• 401K matching plan (1:1 match up to 6% of salary).
• Flexible paid time off, paid holidays, and paid parental leave.
• Collaborative environment with both in-person and virtual social events.