Principal Engineer (AI Inference)

Location: On-site at the Sunnyvale office, United States

Company

hirify.global builds specialized AI hardware and cloud inference infrastructure designed to deliver high-speed AI model training and inference.

What you will do

• Define and prioritize high-leverage technical problems for the Inference Cloud Platform.
• Set long-term direction for multi-region topology, failure domains, service boundaries, and platform evolution.
• Architect active-active systems with rapid failover, circuit breaking, backpressure, load shedding, and clear SLOs.
• Improve latency, throughput, capacity efficiency, and resilience under unpredictable AI workload demand.
• Write and review production code and designs for critical paths, including build-versus-buy decisions.
• Lead production incidents, observability, capacity planning, post-incident improvements, cross-team technical strategy, and mentorship.

Requirements

• 10+ years of software engineering experience, including substantial individual contributor experience with large-scale distributed systems or cloud infrastructure.
• Deep expertise in distributed systems architecture, networking, compute orchestration, container platforms, and multi-region production services.
• Demonstrated experience building highly available, latency-sensitive systems at scale and optimizing high-QPS performance.
• Strong proficiency in Go, C++, or Python, with the ability to contribute production code directly.
• Experience with metrics, logging, tracing, alerting, incident response, and SLI/SLO/SLA-driven operations.
• Ability to influence senior engineers and cross-functional partners through technical judgment, communication, and credibility.

Nice to have

• Experience with TTFT and tail-latency reduction.
• Experience with ML inference infrastructure, model serving systems, or GPU-accelerated workloads.

Culture & Benefits

• Build AI platforms beyond the constraints of traditional GPUs.
• Opportunities to publish and open-source AI research.
• Work with a high-performance AI supercomputer platform.
• Startup vitality combined with job stability.
• Non-corporate culture focused on individual respect, continuous learning, and inclusion.