Manager, Software Development (Hands-On Technical), ML Network Stack (AI)

TL;DR

Manager, Software Development (ML Network Stack): Leading a team developing the network stack for EC2 distributed AI/ML systems with an accent on a variety of frameworks and communication libraries, systems programming, and HW/SW co-design. Focus on directing work for senior, mid-level, and junior SDEs and ensuring delivery of features for the latest ML workloads.

Location: Must be based in the USA (Cupertino, CA or Seattle, WA). Applicants from Los Angeles County will be considered.

Salary: Annually $212,700–$287,700 (Cupertino, CA) or $184,900–$250,200 (Seattle, WA).

Company

Annapurna Labs is an integral part of AWS that designs software, systems, and chips to optimize the AWS customer experience for EC2 infrastructure.

What you will do

• Lead an engineering team responsible for the network stack of EC2 distributed AI/ML systems.
• Develop support for various ML frameworks and communication libraries including NCCL, NVSHMEM, NIXL, NCCL GIN, and Perplexity kernels.
• Direct the work of senior, mid-level, and junior SDEs to deliver features for the latest and largest ML workloads.
• Partner with product or program management teams to collect requirements and define product strategy.
• Maintain active programming proficiency and contribute hands-on to development.

Requirements

• 3+ years of engineering team management experience.
• 5+ years of hands-on engineering experience with active programming proficiency.
• 3+ years of C, C++, or Rust development experience.
• Knowledge of engineering practices for the full software/hardware/networks development life cycle.
• Familiarity with networking (HPC networking preferred) and HW/SW co-design.

Nice to have

• Experience with the NVIDIA stack, ML applications, and frameworks.
• Experience in communicating with users, other technical teams, and senior leadership regarding product features and technical designs.
• Experience in recruiting, hiring, mentoring, and managing Software Engineers.

Culture & Benefits

• Strive for work-life harmony and flexibility as part of the working culture.
• Offers endless knowledge-sharing, mentorship, and other career-advancing resources.
• Comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave.
• Inclusive culture that empowers hirify.globalians to deliver the best results for customers.