Staff Engineer (AI Inference Platform)

Location: On-site in Sunnyvale, United States, or Toronto, Canada

Company

hirify.global builds large-scale AI hardware and infrastructure for high-speed model training and inference.

What you will do

• Design, develop, test, and maintain production software for the Inference Platform orchestration layer.
• Shape the technical direction for Kubernetes operators, custom resource definitions, failure domains, service boundaries, and platform evolution.
• Architect active-active systems with rapid failover, graceful degradation, clear SLOs, and improved latency, throughput, capacity efficiency, and resilience.
• Write and review production code, make high-consequence architectural decisions, and set engineering standards through design and code reviews.
• Lead complex production issues, observability, incident response, capacity planning, and post-incident improvements.
• Partner with ML, Product, Infrastructure, and Cloud teams on scalable system designs and cross-functional technical decisions.

Requirements

• 8+ years of software engineering experience, including substantial individual-contributor work on large-scale distributed systems or cloud infrastructure.
• Deep expertise in distributed systems architecture, ideally with Kubernetes.
• Experience designing highly available, latency-sensitive systems and optimizing latency, throughput, and efficiency in high-QPS environments.
• Experience with certificates, TLS, and mTLS.
• Strong proficiency in Go or C++ and the ability to contribute production code directly.
• Experience with metrics, logging, tracing, alerting, incident response, and SLO-driven operations, plus the ability to influence senior engineers and cross-functional partners.

Nice to have

• Experience with ML inference infrastructure, model serving systems, or GPU-accelerated workloads.
• Experience with TTFT and tail-latency reduction.

Culture & Benefits

• Opportunity to build an AI platform beyond the constraints of GPUs.
• Access to cutting-edge AI research, including publishing and open-source work.
• Work on a high-performance AI supercomputer platform.
• Combination of startup vitality and business stability.
• Non-corporate culture focused on individual beliefs, learning, growth, and inclusion.