Software Engineer, Inference (AI)

TL;DR

Software Engineer, Inference (AI): Building and maintaining critical systems for AI inference to serve millions of users worldwide with an accent on maximizing compute efficiency and enabling breakthrough research. Focus on tackling complex distributed systems challenges across multiple AI hardware and cloud platforms.

Location: Hybrid (San Francisco)

Company

hirify.global is a public benefit corporation focused on creating reliable and interpretable AI systems.

What you will do

• Build and maintain systems for AI inference serving millions of users.
• Optimize request routing and fleet-wide orchestration across diverse AI accelerators.
• Design intelligent routing algorithms for request distribution.
• Autoscale compute fleet to match supply with demand.
• Integrate new AI accelerator platforms.
• Analyze observability data to tune performance.

Requirements

• Significant software engineering experience, particularly with distributed systems.
• Bachelor's degree in a related field or equivalent experience.
• Willingness to work in the office at least 25% of the time.
• Visa sponsorship available for strong candidates.