Engineering Manager (AI)

TL;DR

Engineering Manager (AI): Leading the API Core team to optimize the request lifecycle and "hot path" of the Claude API with an accent on service-level efficiency, throughput scaling, and rate-limiting systems. Focus on reducing per-request overhead, designing distributed systems at scale, and managing infrastructure capacity to maximize model-serving throughput.

Location: Hybrid (must be based in San Francisco, CA or New York City, NY)

Salary: $405,000 - $485,000 USD

Company

hirify.global is a public benefit corporation creating reliable, interpretable, and steerable AI systems.

What you will do

• Lead the API Core team, managing hiring, performance management, and career development.
• Define the technical strategy and delivery roadmap for service efficiency, throughput scaling, and rate-limiting systems.
• Drive multi-quarter initiatives to improve token-path efficiency and implement protocol-level optimizations.
• Partner with Inference and Compute teams on capacity planning and regional load balancing.
• Own the end-to-end rate-limiting and acceleration-limit subsystems, including quota models and enforcement.
• Set and uphold reliability standards and latency SLOs for the /v1/messages API path.

Requirements

• 10+ years of experience managing engineering teams building high-throughput, latency-sensitive backend services.
• Proven track record of improving service efficiency on systems operating at scale (millions of QPS).
• Deep expertise in Rust, Go, systems-level performance engineering, or large-scale distributed systems.
• Ability to make architectural decisions under capacity pressure.
• Must be based in San Francisco or New York City (minimum 25% office presence required).
• Bachelor's degree or equivalent professional experience.

Culture & Benefits

• Competitive compensation and benefits with optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours.
• Collaborative research-driven environment focused on "big science".
• Visa sponsorship available for eligible candidates.