Software Development Engineer II, AWS SageMaker AI

Location: Bellevue, Washington, USA

Salary: $143,700–$194,400 USD annually, plus sign-on payments and restricted stock units.

Company

Amazon AI develops cloud-based artificial intelligence services and platforms through AWS SageMaker AI.

What you will do

• Design, build, test, and operate services that orchestrate foundation-model data preparation, training, evaluation, and deployment.
• Own platform components end to end, including design, implementation, deployment, monitoring, and on-call operations.
• Build compute integrations and job launchers across SageMaker, EMR, AWS Batch, and Kubernetes/EKS.
• Improve resiliency for long-running distributed jobs through checkpointing, recovery, retries, metrics, logging, and experiment tracking.
• Extend the SDK, workflow orchestration, schema and contract layers, and AWS CDK infrastructure.
• Collaborate with ML scientists and internal customers, contribute to architecture discussions, and mentor interns and new engineers.

Requirements

• 3+ years of non-internship professional software development experience.
• 2+ years of experience designing or architecting reliable and scalable systems.
• Experience developing large-scale, multi-tiered, multi-threaded, embedded, or distributed applications using C#, C++, Java, or Perl.
• Experience with object-oriented design and at least one programming language.
• Bachelor’s degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field.
• Experience across the software development lifecycle, including testing and operations.

Nice to have

• Experience with workflow orchestration, event-driven architectures, or service-oriented architectures.
• Experience with Kubernetes/EKS, Ray, Slurm, AWS Batch, AWS CDK, or CloudFormation.
• Experience operating managed cloud services at scale with checkpointing and fault tolerance.
• Familiarity with ML training workflows, GPU or accelerator computing, PyTorch FSDP, Megatron-LM, DeepSpeed, or verl.

Culture & Benefits

• Health, dental, vision, prescription, life, and accidental death and dismemberment insurance.
• 401(k) matching, paid time off, and parental leave.
• Flexible spending accounts, employee assistance, mental health support, and medical advice services.
• Sign-on payments and restricted stock units may be included in the compensation package.
• Inclusive workplace with accommodation support throughout the hiring and onboarding process.