Senior Applied AI Engineer (AI)

TL;DR

Senior Applied AI Engineer (AI): Building and optimizing next-generation AI assistant and productivity capabilities with an accent on LLM product engineering, evaluation science, and internal tool development. Focus on designing agentic behaviors, creating robust evaluation frameworks, and shipping production-grade features in a high-velocity environment.

Location: Redmond, WA (with specific pay bands for San Francisco Bay Area and New York City)

Salary: $119,800 – $304,200 per year (varies by role level and location)

Company

A global technology leader in software, computing, and artificial intelligence.

What you will do

• Design and deploy LLM-powered assistant features including agentic behaviors and retrieval pipelines.
• Develop and maintain evaluation frameworks to ensure quality, safety, and correctness.
• Build internal tooling for prompt experimentation and debugging automated evaluation pipelines.
• Integrate LLMs with existing product surfaces, APIs, and backend infrastructure.
• Iterate rapidly using hillclimbing loops to improve model performance and user experience.
• Collaborate cross-functionally with research, design, and product teams to ship high-impact features.

Requirements

• Bachelor’s Degree in Computer Science or related technical field.
• 4+ years of technical engineering experience coding in languages such as Python, C, C++, C#, or Java.
• Must be based in the United States.
• Strong problem-solving skills and experience with applied ML systems.
• Experience shipping production-level code or AI products.
• Bias for action and ability to operate effectively in a fast-paced environment.

Nice to have

• Master’s or PhD in Engineering, Applied Math, Statistics, or related analytical field.
• Experience working in startup environments or on zero-to-one product initiatives.
• 1+ year of experience using AI-assisted coding and analysis techniques.
• Hands-on experience with hillclimbing AI evaluations.

Culture & Benefits

• Comprehensive health, dental, and vision insurance.
• Participation in corporate compensation and benefits programs.
• Opportunity to work on large-scale AI products with significant user impact.
• Culture of experimentation and rapid innovation.
• Support for inclusive work practices and accommodations.