Director Of Infrastructure Engineering (AI)

TL;DR

Director of Infrastructure Engineering (AI): Leading and scaling core cloud and bare-metal environments for a high-growth AI infrastructure platform with an accent on SRE, global networking, and distributed storage engines. Focus on architecting ultra-low-latency HPC networks and building a high-output engineering organization to support massive GPU computing demands.

Location: Must be based in the United States

Salary: $225,000 - $325,000

Company

hirify.global is an AI Developer Cloud platform enabling researchers and teams to train, fine-tune, and deploy AI models at scale.

What you will do

• Lead and scale engineering teams responsible for SRE, global networking, and distributed storage.
• Architect and optimize ultra-low-latency HPC cluster networks using InfiniBand and RoCE.
• Direct the performance tuning of scalable storage systems to support massive IOPS for deep learning.
• Hire, mentor, and grow senior engineering managers and ICs in a remote-first environment.
• Partner with product and program leadership to translate scale requirements into technical roadmaps.
• Establish rigorous SRE practices, including SLA/SLO definitions and automated incident response.

Requirements

• Must be eligible to work in the United States (no visa sponsorship available)
• 7+ years of leadership experience managing managers and multiple engineering squads.
• 8+ years of experience building and operating large-scale distributed systems or cloud platforms.
• Deep architectural understanding of HPC networking, InfiniBand, RoCE, and BGP.
• Proven experience with high-performance distributed storage systems like Ceph, Lustre, or Weka.
• Strong foundation in SRE culture, Kubernetes, Terraform, and Ansible.

Nice to have

• Direct experience architecting infrastructure for massive GPU clusters and AI/ML workloads.
• Deep understanding of hardware architectures, NVLink, and datacenter topology.
• Track record of scaling infrastructure teams in hyper-growth startup environments.
• Active recognition or open-source contributions within the infrastructure or Kubernetes communities.

Culture & Benefits

• Meaningful equity in a fast-growing company.
• Generous medical, dental, and vision insurance plans.
• Flexible PTO policy to support work-life balance.
• $1,200 home office and equipment stipend.
• Remote-first culture with collaborative team communication via Slack.