Software Engineer (Infrastructure)

TL;DR

Software Engineer (Infrastructure): Build and maintain components of a machine learning inference platform powering production AI applications with an accent on multi-cloud capacity management, GPU inference optimization, and scalable infrastructure. Focus on developing Kubernetes deployments, resource management, and monitoring systems to ensure high performance and reliability.

Location: Remote (US), San Francisco, New York

Salary: $150000–$230000

Company

hirify.global powers inference for leading AI companies by uniting applied AI research, flexible infrastructure, and developer tooling, backed by $150M Series D funding.

What you will do

• Develop infrastructure components for ML inference platform using Python and Go
• Implement and maintain Kubernetes deployments for model serving
• Contribute to inference orchestration and resource management for ML workloads
• Build and enhance monitoring systems for model performance
• Support infrastructure automation to improve ML deployment workflows
• Collaborate with team members on technical solutions and infrastructure improvements

Requirements

• Bachelor's degree or higher in Computer Science or related field
• 1-3 years experience in software engineering or infrastructure
• Proficient coding skills; Go proficiency is a plus
• Working knowledge of Kubernetes and containerization
• Basic understanding of machine learning concepts and model serving
• Familiarity with distributed systems and monitoring tools
• Strong collaboration and communication skills

Culture & Benefits

• Competitive compensation with meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Generous PTO including company-wide Winter Break
• Paid parental leave and company-facilitated 401(k)
• Exposure to diverse ML startups and networking opportunities