Staff Software Engineer (AI)

TL;DR

Staff Software Engineer (AI): Defining and evolving the architecture for Kubernetes-native orchestration of AI workloads across large GPU clusters with an accent on scalability, reliability, and developer experience. Focus on designing robust orchestration primitives and resolving systemic performance and fairness issues.

Location: Sunnyvale, CA / Bellevue, WA. hirify.global prioritizes a hybrid work environment; however, remote work may be considered for candidates located more than 30 miles from an office, based on role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of hirify.global's hubs within their first month. This position requires compliance with U.S. export regulations, meaning applicants must be a U.S. person (U.S. citizen, national, lawful permanent resident, refugee, or asylee) or eligible to obtain required export authorization.

Salary: $188,000–$275,000 base salary, plus discretionary bonus and equity awards.

Company

hirify.global is The Essential Cloud for AI™, delivering a platform that enables innovators to build and scale AI with confidence.

What you will do

• Act as a technical leader for hirify.global’s Kubernetes-native orchestration strategy for AI workloads.
• Define and evolve the architecture for how AI workloads are admitted, scheduled, and governed across large GPU clusters.
• Design scalable, reliable orchestration primitives for AI workloads across multiple schedulers and runtimes (e.g., Kueue, Volcano, Ray).
• Lead cross-team architecture reviews and drive alignment across infrastructure, CKS, and managed inference teams.
• Define platform standards for reliability, observability, capacity management, and operational excellence.
• Mentor senior engineers and represent the platform in technical reviews to influence broader hirify.global platform strategy.

Requirements

• 8+ years of professional software engineering experience, with deep expertise in distributed systems or cloud platforms.
• Strong proficiency in Go and experience designing large-scale, long-lived production systems.
• Deep knowledge of Kubernetes internals, scheduling mechanisms, and controller-based architectures.
• Demonstrated experience designing or evolving orchestration, scheduling, or resource-management platforms.
• Proven ability to lead technical initiatives across teams without direct authority.
• Must be a U.S. person, defined as a U.S. citizen or national, U.S. lawful permanent resident (green card holder), refugee, or asylee, or eligible to access/obtain required export authorization.

Nice to have

• Hands-on experience with Kueue, Volcano, Ray, or similar Kubernetes-native orchestration frameworks.
• Background in AI infrastructure, ML platforms, HPC, or large-scale batch and streaming systems.
• Deep understanding of scheduling concepts including fairness, pre-emption, quota management, and multi-tenant isolation.
• Experience defining and operating SLOs, capacity models, and large-scale reliability improvements.
• Contributions to open-source infrastructure or orchestration projects.

Culture & Benefits

• Competitive salary, discretionary bonus, equity awards, and a comprehensive benefits program.
• Medical, dental, and vision insurance (100% company-paid), company-paid life insurance, short and long-term disability insurance.
• Flexible Spending Account (FSA), Health Savings Account (HSA), and 401(k) with a generous employer match.
• Tuition reimbursement, mental wellness benefits, family-forming support, and paid parental leave.
• Flexible PTO and a casual work environment focused on innovative disruption.
• Catered lunch each day in office and data center locations.