SoC Platform Software Engineering Manager (AI)

TL;DR

SoC Platform Software Engineering Manager (C++/Embedded): Leading the development of the Hardware Abstraction Layer (HAL) for AWS's custom Trainium and Inferentia ML accelerators with an accent on portable software architecture and platform abstractions. Focus on creating a single C++ codebase that runs across verification, emulation, and production environments while ensuring system resilience and high-performance HW/SW interaction.

Location: Must be based in Cupertino, CA or Austin, TX

Salary: $184,900 – $287,700 annually

Company

Annapurna Labs (AWS) designs and develops custom ML accelerator chips to power the next generation of AI training and inference.

What you will do

• Manage, coach, and grow a team of 6 engineers, overseeing technical direction and hiring.
• Own the platform abstraction layer enabling a single C++ codebase to run across three different target environments.
• Define and shape external API contracts for verification, emulation, and production teams.
• Drive the architecture of the C++ template metaprogramming framework for type-safe register interfaces.
• Establish CI/CD and validation strategies to catch integration issues before production.
• Coordinate with chip architects, RTL designers, and validation engineers to ensure HAL readiness for new chip programs.

Requirements

• 3+ years of engineering team management experience.
• 7+ years of professional software development in C or C++, specifically in systems or platform software.
• 4+ years of experience in software architecture (API design, platform abstractions).
• Experience developing software that interfaces directly with hardware.
• Experience designing APIs consumed by other internal engineering teams.

Nice to have

• Experience with HAL, BSP, or platform software for SoC/ASIC/embedded systems.
• Familiarity with bus protocols such as APB, AXI, PCIe, or memory subsystems (HBM, DDR).
• Experience with C++ template metaprogramming or code generation frameworks.
• Knowledge of pre-silicon development (simulation, emulation, virtual platforms).
• Experience with multi-platform or cross-compilation build systems.

Culture & Benefits

• Comprehensive health insurance (medical, dental, vision, prescription).
• 401(k) matching and restricted stock units (RSUs).
• Sign-on payments.
• Paid time off and parental leave.
• Support for mental health and flexible spending accounts.