Manager, Software Development (ML Network Stack)

TL;DR

Manager, Software Development (ML Network Stack): Leading the team responsible for the network stack of EC2 distributed AI/ML systems with an accent on HW/SW co-design and HPC networking. Focus on developing support for communication libraries like NCCL, NVSHMEM, and NIXL to optimize large-scale ML workloads.

Location: Tel Aviv, Israel

Company

Annapurna Labs, an integral part of AWS, develops critical hardware and software components that serve as building blocks for EC2 infrastructure.

What you will do

• Lead a mid-sized team of senior, mid-level, and junior SDEs.
• Direct the development of the network stack for distributed AI/ML systems on EC2.
• Oversee the implementation of support for frameworks and libraries including NCCL, NVSHMEM, NIXL, and Perplexity kernels.
• Ensure the delivery of functions and features required for the largest ML workloads.
• Partner with product and program management teams to align technical delivery with strategy.

Requirements

• 5+ years of engineering team management experience.
• 5+ years of hands-on engineering experience, maintaining active programming proficiency.
• 3+ years of development experience in C, C++, or Rust.
• Deep knowledge of engineering practices for the full software/hardware/networks development life cycle.
• Experience with systems programming and HW/SW co-design.

Nice to have

• Familiarity with HPC networking and the NVIDIA stack.
• Experience with ML applications and frameworks.
• Proven track record in recruiting, hiring, and mentoring software engineers.
• Experience communicating technical designs and product strategy to senior leadership.

Culture & Benefits

• Commitment to work-life harmony and flexibility within the working culture.
• Endless knowledge-sharing, mentorship, and career-advancing resources.
• Inclusive culture that values diverse professional backgrounds and unconventional career paths.
• High-performance environment focused on becoming Earth's Best Employer.