TL;DR

Applied Scientist II (AI): Designing agentic architectures, developing tools and datasets, and contributing to building systems that can reason, plan, and act autonomously across complex advertiser workflows with an accent on fine-tuning, reinforcement learning, and preference optimization. Focus on experimenting with and applying core primitives such as tool orchestration, multi-step reasoning, and adaptive preference-driven behavior.

Location: Must be eligible to work in the US, as compensation is based on US geographic markets.

Salary: $136,000–$223,400 per year

Company

The Amazon Ads team is reimagining the advertising landscape through the latest generative AI technologies, revolutionizing how millions of customers discover products and engage with brands across Amazon.com and beyond.

What you will do

Design and build agents for autonomous campaigns experiences.
Design and implement advanced model and agent optimization techniques, including supervised fine-tuning, instruction tuning, and preference optimization (e.g., DPO/IPO).
Curate datasets and tools for MCP.
Build evaluation pipelines for agent workflows, including automated benchmarks, multi-step reasoning tests, and safety guardrails.
Develop agentic architectures (e.g., CoT, ToT, ReAct) that integrate planning, tool use, and long-horizon reasoning.
Prototype and iterate on multi-agent orchestration frameworks and workflows.
Collaborate with peers across engineering and product to bring scientific innovations into production.
Stay current with the latest research in LLMs, RL, and agent-based AI, and translate findings into practical applications.

Requirements

PhD, or Master's degree and 4+ years of CS, CE, ML, or related field experience.
3+ years of experience building models for business applications.
Experience programming in Java, C++, Python, or related language.
Experience in designing experiments and statistical analysis of results.
Experience with AI/ML technologies.

Nice to have

Experience in professional software development.
Experience in state-of-the-art deep learning model architecture design and deep learning training and optimization and model pruning.

Culture & Benefits

Inclusive culture empowering Amazonians to deliver the best results for customers.
Dedicated to developing responsible and intelligent AI technologies.
Full range of medical, financial, and other benefits.
Opportunity for equity, sign-on payments, and other forms of compensation.
Support for disability accommodation or adjustment during the application and hiring process.

Applied Scientist II, Sponsored Products Autonomous Campaigns (AI)