Product Manager (Infrastructure)

TL;DR

Product Manager (Infrastructure): Own the roadmap and development of core inference and compute infrastructure for AI model deployment with an accent on reliability, scalability, and performance. Focus on defining product vision, collaborating with engineering on distributed systems and GPU optimization, and driving infrastructure investments for enterprise-grade security and observability.

Location: San Francisco, New York

Salary: $200000–$275000

Company

hirify.global powers inference infrastructure for leading AI companies, combining applied AI research, flexible infrastructure, and developer tooling, backed by $150M Series D funding.

What you will do

• Define product vision and roadmap for inference, serving, and orchestration infrastructure
• Collaborate with engineering to improve reliability, latency, and cost efficiency of model deployments
• Partner with Forward Deployed Engineering and customers to translate performance needs into infrastructure investments
• Drive platform scalability from multi-GPU support to hybrid cloud architecture
• Establish metrics for uptime, latency, and cost to ensure best-in-class performance
• Lead cross-functional initiatives on observability, deployment automation, and infrastructure security

Requirements

• 4+ years of Product Management experience in developer platforms, infrastructure, or ML systems
• Engineering background or equivalent hands-on software engineering experience
• Strong technical understanding of distributed systems, cloud computing, and GPU workloads
• Proven track record of shipping technical products with measurable reliability or performance improvements
• Excellent communication and prioritization skills with technical teams

Nice to have

• Experience with Kubernetes, autoscaling systems, or inference optimization
• Understanding of LLM and multimodal model serving
• Prior experience building infrastructure for ML or developer tools

Culture & Benefits

• Competitive compensation including meaningful equity
• 100% coverage of medical, dental, and vision insurance for employee and dependents
• Generous PTO policy including company-wide Winter Break
• Paid parental leave
• Company-facilitated 401(k)
• Exposure to a variety of ML startups for learning and networking