Senior Software Development Manager (AI, Neuron SDK)

TL;DR

Senior Software Development Manager (AI, Neuron SDK): Leading a team to build fundamental inference technology building blocks and libraries for AI developers to optimize models on Trainium and Inferentia devices with an accent on the full development life cycle, reliability, and scalability. Focus on developing Neuronx_Distributed Inference Libraries and contributing to open-source inference libraries to optimize LLMs, multimodal, and generative models.

Location: Implied within the United States due to salary market specifics.

Salary: $198,100–$342,300/year

Company

Amazon Web Services (AWS) is the world’s most comprehensive and broadly adopted cloud platform, pioneering cloud computing.

What you will do

• Lead and manage a team of managers and engineers.
• Build fundamental inference technology building blocks and libraries for AI developers.
• Develop the Neuronx_Distributed Inference Libraries and contribute to open-source inference libraries.
• Define product directions and deliver solutions with executive leadership.
• Develop the full software stack for massive-scale distributed training and inference solutions.
• Ensure reliability and scalability across the full development life cycle.

Requirements

• 10+ years of engineering experience.
• 5+ years of engineering team management experience.
• 10+ years of experience in planning, designing, developing, and delivering consumer software.
• Experience partnering with product or program management teams.
• Experience managing multiple concurrent programs, projects, and development teams in an Agile environment.
• Strong technical ability to understand and manage a vertically integrated system stack consisting of hardware, frameworks, and workflows.

Nice to have

• Experience designing and developing large scale, high-traffic applications.

Culture & Benefits

• Emphasis on work-life harmony and flexibility.
• Access to endless knowledge-sharing, mentorship, and career-advancing resources.
• Inclusive culture that empowers Amazonians.
• Comprehensive medical, financial, and other benefits as part of a total compensation package.