Staff + Senior Software Engineer (AI)

TL;DR

Staff + Senior Software Engineer (Inference): Building and maintaining critical distributed systems that serve Claude to millions of users with an accent on compute efficiency and high-performance infrastructure. Focus on designing intelligent request routing, fleet-wide orchestration, and integrating diverse AI accelerators to support next-generation model development.

Location: Must be based in or able to work from San Francisco, CA, New York City, NY, or Seattle, WA (Hybrid: 25%+ in-office)

Salary: $320,000 - $485,000 USD

Company

hirify.global is an AI safety and research company dedicated to building reliable, interpretable, and steerable AI systems.

What you will do

• Design and maintain distributed systems serving Claude to millions of users.
• Develop intelligent request routing, load balancing, and traffic management systems.
• Maximize compute efficiency through autoscaling and orchestration across thousands of accelerators.
• Build production-grade deployment pipelines for new model releases.
• Integrate new AI accelerator platforms and support inference for emerging model architectures.
• Use observability data to tune and improve performance based on real-world workloads.

Requirements

• Must be able to work from San Francisco, New York City, or Seattle (Hybrid policy).
• Significant software engineering experience with distributed systems.
• Results-oriented mindset with a bias for impact and flexibility.
• Strong desire to learn about machine learning systems and infrastructure.
• Excellent communication skills and enthusiasm for pair programming.
• Commitment to the societal impacts of AI work.

Nice to have

• Experience with high-performance, large-scale distributed systems.
• Experience deploying machine learning systems at scale.
• Familiarity with LLM inference optimization, batching, and caching.
• Proficiency in Python or Rust.
• Experience with Kubernetes and cloud infrastructure (AWS, GCP, Azure).

Culture & Benefits

• Competitive compensation and benefits package.
• Generous vacation and parental leave policies.
• Flexible working hours.
• Collaborative research-driven environment with frequent technical discussions.
• Visa sponsorship support available for qualified candidates.