Senior Software Engineer - Infrastructure (AI)

TL;DR

Senior Software Engineer - Infrastructure (AI): Architecting and leading the development of an ML inference platform that powers production AI applications with an accent on high performance and reliability. Focus on optimizing Kubernetes deployments, GPU capacity management, and infrastructure automation for seamless ML deployment workflows.

Location: San Francisco

Salary: $150K – $230K

Company

hirify.global powers mission-critical inference for the world's most dynamic AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling.

What you will do

• Design and architect scalable infrastructure systems for our ML inference platform.
• Lead optimization of Kubernetes deployments for efficient, cost-effective model serving.
• Define monitoring strategies for model performance, latency, and resource utilization.
• Develop advanced solutions for GPU capacity management and throughput optimization.
• Establish infrastructure automation standards to streamline ML deployment workflows.
• Contribute to long-term technical strategy and infrastructure roadmap.

Requirements

• Bachelor's degree or higher in Computer Science or related field.
• 5+ years experience building production infrastructure systems.
• Expert-level proficiency in Go, with Python experience a plus.
• Deep expertise with Kubernetes in production environments.
• Extensive experience with major cloud providers (AWS, GCP) a plus.
• Advanced understanding of distributed systems concepts and performance tuning.

Nice to have

• Experience with ML/AI workloads and MLOps platforms highly valued.

Culture & Benefits

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents.
• Generous PTO policy including company wide Winter Break.
• Paid parental leave.
• Company-facilitated 401(k).
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.