Member Of Technical Staff (Cloud Infrastructure, AI)

TL;DR

Member Of Technical Staff (Cloud Infrastructure, AI): Architecting and building the foundational backend systems that power a global generative AI platform with an accent on distributed training, inference pipelines, and scalable cloud-native infrastructure. Focus on designing low-latency model serving layers, optimizing compute/storage costs, and ensuring high-performance reliability across massive scale.

Location: Must be based in New York, NY or San Mateo, CA

Salary: $175,000 - $220,000 USD

Company

hirify.global is a Series C generative AI infrastructure startup building the fastest and most scalable LLM inference platform in the industry.

What you will do

• Architect and build scalable backend infrastructure for distributed training and inference pipelines.
• Design core services including job schedulers, resource managers, and autoscalers.
• Lead technical design discussions and mentor engineering team members on best practices.
• Drive initiatives for infrastructure optimization including cost reduction and performance tuning.
• Collaborate with ML, DevOps, and product teams to translate research into production-ready solutions.
• Own end-to-end systems from design to deployment with a focus on fault tolerance and observability.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or equivalent practical experience.
• 5+ years of experience building backend infrastructure in cloud environments.
• Proven experience in ML infrastructure and tooling like PyTorch, TensorFlow, or Kubernetes.
• Strong software development skills in Python or C++.
• Deep understanding of distributed systems fundamentals including orchestration, networking, and compute optimization.
• Must be based in the US (New York or San Mateo).

Nice to have

• Master’s or PhD in Computer Science or related field.
• Experience with infrastructure-as-code and CI/CD tooling like Terraform, ArgoCD, or GitOps.
• Track record of improving system performance and cost-efficiency at scale.
• Contributions to open-source cloud or ML infrastructure projects.

Culture & Benefits

• Meaningful equity in a fast-growing startup.
• Opportunity to solve bleeding-edge AI infrastructure challenges.
• Collaborative environment with world-class engineers and researchers.
• Direct ownership and impact on global AI products.
• Comprehensive benefits package and competitive salary.