Senior Software Engineer (AI/HPC)

Location: Remote for employees residing within the United States; department location listed as Austin, Texas.

Company

hirify.global develops scale-out networking solutions integrating hardware, software, and system-level technologies for AI and HPC datacenters.

What you will do

• Design and implement performance-critical CCL enablement features for hirify.global fabrics.
• Optimize distributed training across multi-node, multi-GPU configurations, including GPU-direct transfers, IPC, and CPU/GPU synchronization.
• Profile AI workloads, identify bottlenecks across the software and hardware stack, and provide robust fixes for advanced escalations.
• Tune PyTorch Distributed, TensorFlow/XLA, JAX, DeepSpeed, and Megatron-LM workloads.
• Develop model-aligned benchmarks and microbenchmarks, prototype Ultra Ethernet capabilities, and validate deployment performance.
• Contribute upstream to AI communication and distributed training projects while participating in design reviews, code reviews, CI, maintenance, and cross-functional collaboration.

Requirements

• 8+ years of experience in high-performance systems programming in C/C++ on Linux.
• Strong experience with GPU communication stacks including CUDA/ROCm and NCCL/RCCL.
• Ability to optimize distributed training performance using profiling and tracing.
• Understanding of collective communication concepts and topology awareness.
• Experience delivering production-quality code.
• Open-source contributions in relevant areas.

Nice to have

• Experience with AI frameworks such as PyTorch Distributed, DeepSpeed, and Megatron-LM.
• Familiarity with libfabric/OFI, UCX, and RDMA concepts.
• Experience with RoCEv2 and Ultra Ethernet.
• Experience building cluster-scale performance test infrastructure.

Culture & Benefits

• Flexible remote, hybrid, and onsite roles are available across a global organization spanning six countries.
• Compensation includes base pay, equity, cash, and performance-based incentives.
• Benefits include medical, dental, vision, disability, life, dependent care, accidental injury, and pet insurance.
• Benefits include paid holidays, 401(k) with company match, Open Time Off for regular full-time exempt employees, sick time, bonding leave, and pregnancy disability leave.
• Work involves collaboration with semiconductor industry leaders and engineering teams across kernel/driver, switch, performance, and systems functions.