Senior AI Infrastructure Engineer (PyTorch)

Location: Redwood City, CA (Hybrid)

Company

hirify.global is building unified general intelligence capable of generating, understanding, and operating in the physical world through multimodal models.

What you will do

• Design, implement, and optimize distributed training systems for models running on thousands of GPUs.
• Research and apply advanced parallelization techniques including FSDP, Tensor, Pipeline, and Expert Parallelism.
• Develop monitoring, visualization, and debugging tools to ensure large-scale training reliability.
• Optimize training stability, convergence, and resource utilization across massive GPU clusters.

Requirements

• Extensive experience with distributed PyTorch training and parallelisms in foundation-model training.
• Deep understanding of GPU clusters, networking, and storage systems.
• Proficiency with communication libraries such as NCCL and MPI.
• Proven track record of solving complex problems in distributed-system optimization.
• Must be able to work in a hybrid capacity in Redwood City, CA.

Nice to have

• Strong Linux systems administration and scripting skills.
• Experience managing training runs across 100+ GPUs.
• Familiarity with containerization, orchestration, and cloud infrastructure.

Culture & Benefits

• Opportunity to work on cutting-edge multimodal foundation models.
• Focus on high-impact infrastructure challenges at massive scale.
• Collaborative research-driven environment.
• Equal opportunity employer.