Senior Software Developer - Network and Collectives (C++)

Location: Hybrid work model in Israel, with primary location in Haifa and an additional location in Petah-Tikva. The role combines on-site work at the assigned site with off-site work.

Company

hirify.global develops technology for online grocery commerce and AI accelerator infrastructure.

What you will do

• Design and implement collective communication algorithms tuned to interconnect topology and bandwidth and latency characteristics.
• Build topology-aware transport across tray, rack, and pod interconnects.
• Optimize collective performance across multi-node pods through profiling, bottleneck analysis, and fabric-level tuning.
• Co-design interconnect features with hardware teams and coordinate partitioning, overlap, and scheduling with the Multi-Node Runtime team.
• Own correctness and numerical determinism of reductions at scale.

Requirements

• 5+ years of experience in AI, systems, or HPC software development.
• Strong C++ skills with experience in concurrency and lock-free design.
• Hands-on experience with collective libraries such as NCCL or MPI, or with scale-out communication.
• Working knowledge of tensor, pipeline, and expert parallelism and their mapping to collectives and hardware fabrics.
• Experience with profiling, bandwidth and latency tuning, and roofline reasoning.

Nice to have

• Experience with topology or placement algorithms, congestion control, or multi-tenant fabrics.
• Exposure to large-scale distributed training or inference.
• Experience with vLLM, SGLang, TensorRT-LLM, or DeepSeek.
• Experience with RDMA, InfiniBand, RoCE, GPUDirect-style transfers, or comparable fabric technologies.

Culture & Benefits

• Hybrid work model combining on-site and off-site work.
• Close collaboration with hardware and multi-node runtime teams.
• Shift 1 aligned with Israel.
• Full-time experienced-hire position.