Software Development Engineer II, AWS Marketplace & Partner Services (AMPS)

TL;DR

Software Development Engineer II, AWS Marketplace & Partner Services (AMPS) (AI/LLM infrastructure): Design and build infrastructure and tooling for AI solutions, including LLM training pipelines, custom LLM model hosting, and AI agent monitoring and evaluation infrastructure, with an accent on scalable production systems and observability. Focus on building reusable APIs and automation that accelerate experimentation and deployment, while translating ML/AI innovations into reliable, cost-efficient cloud services.

Company

Amazon AI builds AI solutions and infrastructure for AWS Marketplace & Partner Services.

What you will do

• Design, develop, and maintain scalable infrastructure for LLM training pipelines, model hosting, and agent-based systems.
• Build and operate monitoring, evaluation, and observability frameworks for AI agent performance and reliability in production.
• Develop reusable tooling, APIs, and automation to accelerate experimentation, deployment, and iteration on ML/AI solutions.
• Rapidly prototype and operationalize infrastructure leveraging recent ML/AI advances.
• Collaborate cross-functionally with Data Scientists, Applied Scientists, Data Engineers, Software Engineers, and Product Managers to productionize scientific innovations.
• Contribute to research initiatives through experiments, prototyping, and co-authoring internal and external publications.

Requirements

• Location: USA, WA, Seattle
• Bachelor’s degree (or foreign equivalent) in Computer Science, Engineering, Mathematics, or a related field.
• 3+ years of non-internship professional software development experience.
• 2+ years of non-internship system design/architecture experience (design patterns, reliability, scaling).
• 2+ years of experience working with cloud services (AWS, Azure, or GCP).
• 2+ years designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services.

Culture & Benefits

• Comprehensive benefits including health insurance, 401(k) matching, paid time off, and parental leave.
• Sign-on payments and restricted stock units (RSUs) included in the Amazon compensation package.
• Mentorship and career growth through knowledge sharing and resources.
• Work-life balance with flexibility as part of the working culture.
• Inclusive team culture with employee-led affinity groups and inclusion events.

Hiring process

• Compensation and final offer determined based on experience, qualifications, and location.