Senior DevOps Engineer (AI)

TL;DR

Senior DevOps Engineer (AI): Building and scaling robust infrastructure for microservices-based AI platforms with an accent on Kubernetes orchestration, GPU-based ML inference, and observability. Focus on implementing GitOps, Infrastructure as Code, and ensuring high availability for production-grade generative AI products.

Company

hirify.global is a startup building award-winning AI products, including voice assistants and agentic architectures, with a focus on privacy and on-premises deployment.

What you will do

• Deploy and operate microservices-based platforms across AWS, GCP, and on-prem environments.
• Manage and scale GPU-based ML inference services using Triton and vLLM.
• Design and maintain CI/CD pipelines using GitHub and GitLab.
• Develop and evolve observability systems using Grafana, Prometheus, and the ELK stack.
• Ensure platform compliance with SOC 2 security requirements.
• Manage infrastructure using Terraform and Ansible with a strong focus on IaC principles.

Requirements

• Minimum 5 years of experience in DevOps or SRE roles.
• Extensive experience deploying and scaling Kubernetes in cloud and bare-metal environments.
• Deep expertise in Linux system administration and cloud providers, preferably GCP.
• Advanced proficiency in Terraform, Ansible, and Python.
• Strong adherence to GitOps and CI/CD principles.
• Ability to work in high-uncertainty environments with a proactive, strategic mindset.

Nice to have

• Practical experience with ML inference on GPU/CPU.

Culture & Benefits

• Fully remote work environment.
• 21 vacation days plus public holidays and 5 sick days.
• Participation in Employee Stock Ownership Plan (ESOP).
• Private English lessons via Preply.
• Opportunity to work on high-impact AI products with a senior-heavy engineering team.