Software Development Engineer 2 (AI)

TL;DR

Software Development Engineer 2 (AI/ML): Building and optimizing distributed AI/ML systems focused on collective operations for large-scale clusters with an accent on low-level C/C++ development, Linux kernels, and HPC interconnects. Focus on solving hard problems in scaling AI across multiple accelerators and servers and delivering performant, meaningful solutions.

Location: Must be based in the USA, specifically Cupertino, CA

Salary: $165,200–$223,600 annually

Company

Annapurna Labs, an integral part of AWS, develops hardware and software components critical for EC2 infrastructure and optimizes the AWS customer experience.

What you will do

• Work on distributed AI/ML systems and collective operations for scaling AI across accelerators and servers.
• Develop low-level C/C++ code, focusing on Linux kernels and performant systems.
• Design and optimize networking solutions for Machine Learning (ML) and High-Performance Computing (HPC) workloads on AWS.
• Collaborate with infrastructure experts, hardware engineers, RTL engineers, scientists, and architects.
• Deliver meaningful solutions at scale for the largest AI models and customers.

Requirements

• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship experience in designing or architecting new and existing systems.
• Experience programming with at least one software programming language (C/C++ or Python preferred).
• Knowledge of Linux fundamentals.
• English: B2 required.
• Work authorization for the USA required.

Nice to have

• 3+ years of full software development life cycle experience.
• Bachelor's degree in computer science or equivalent.
• Knowledge of Python and/or C++ programming.
• Experience with embedded systems.
• Experience with high-speed networking or HPC interconnects.

Culture & Benefits

• Work at the forefront of AI/ML advancements in a fast-paced environment.
• Benefit from senior mentorship and opportunities to mentor new/junior engineers.
• Enjoy flexibility in working hours and a strong emphasis on work-life balance.
• Access to continuous learning and career growth opportunities within the AI/ML field.
• Be part of an inclusive team culture that values diverse experiences.
• Receive comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave.