Engineering Manager (AI Infrastructure)

TL;DR

Engineering Manager (AI Infrastructure): Leading the Runtime Fabrics team to build purpose-built container runtime and storage layers for AI inference with an accent on GPU-specific performance, multi-tenant isolation, and large-scale model weight delivery. Focus on driving technical direction for containerd and OCI projects while growing a world-class team of systems engineers.

Location: Must be based in or able to work from San Francisco (Hybrid)

Compensation: $165,000 – $330,000 + Equity

Company

hirify.global powers mission-critical inference for the world's most dynamic AI companies, providing flexible infrastructure and developer tooling to bring cutting-edge models into production.

What you will do

• Recruit, hire, and develop a high-performing team of systems engineers.
• Guide the hardening of containerd and runc to meet GPU-specific requirements for AI inference.
• Oversee the architecture of the hirify.global Delivery Network for optimized model weight and image delivery.
• Provide technical oversight on GPU-aware isolation mechanisms and secure container runtimes.
• Champion open-source contributions to the containerd ecosystem.
• Collaborate with product and engineering leadership to define infrastructure roadmaps.

Requirements

• Proven experience managing and growing engineering teams in systems or infrastructure contexts.
• Deep familiarity with the Linux container ecosystem (containerd, runc, OCI, namespaces, cgroups).
• Contributions to containerd, runc, gVisor, or related open-source projects.
• Strong systems programming background in Go or C++.
• Experience with distributed storage systems or large-scale caching infrastructure.
• Strong written and verbal communication skills.

Nice to have

• Experience with NVIDIA Container Toolkit or GPU-aware scheduling.
• Familiarity with lazy-loading snapshotters or peer-to-peer image distribution.
• Experience with secure container runtimes like gVisor or micro-VMs.
• Understanding of containerd shim API v2.

Culture & Benefits

• Competitive compensation with meaningful equity grants.
• 100% coverage of medical, dental, and vision insurance for employees and dependents.
• Flexible PTO policy including a company-wide Winter Break.
• Paid parental leave and fertility/family-building stipends.
• Company-facilitated 401(k).
• Exposure to a variety of ML startups and networking opportunities.