OS / K8s Systems Engineer (AI)

TL;DR

OS / K8s Systems Engineer (AI): Building automation and systems to transform raw GPU hardware into production-ready compute with an accent on OS imaging and provisioning pipelines. Focus on designing zero-to-cluster automation, ensuring reproducible infrastructure across data centers, and optimizing GPU utilization.

Location: Hybrid in San Francisco or New York

Salary: $165K – $330K + Equity

Company

hirify.global powers mission-critical inference for leading AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling.

What you will do

• Own end-to-end automation of cluster bring-up and lifecycle management.
• Build and maintain OS images, provisioning systems, and configuration pipelines.
• Deploy and operate cluster orchestration platforms such as Kubernetes or Slurm.
• Design systems for reproducibility across different sites and hardware generations.
• Automate upgrades, rollouts, and failure recovery processes.
• Optimize system performance, specifically focusing on GPU utilization and networking.

Requirements

• Experience building and operating automated infrastructure systems.
• Strong programming skills in Python, Go, or similar languages.
• Deep familiarity with Linux systems, including boot processes, drivers, and performance.
• Experience with provisioning systems such as PXE, imaging, and configuration management.
• Experience with Kubernetes.
• Must be based in or able to work from San Francisco or New York

Nice to have

• Experience working with GPU or high-performance workloads.

Culture & Benefits

• Competitive compensation with meaningful equity grants.
• 100% coverage of medical, dental, and vision insurance for employee and dependents.
• Flexible PTO policy including a company-wide Winter Break.
• Paid parental leave and fertility/family-building stipend through Carrot.
• Company-facilitated 401(k).