Frontier Agents Engineer (Applied AI)

TL;DR

Frontier Agents Engineer (Applied AI): Designing and deploying production AI agents for enterprise customers with an accent on reasoning, retrieval, and multi-agent coordination. Focus on bridging the gap between frontier AI research and scalable production systems through rigorous evaluation and architectural design.

Location: Not explicitly stated, but company references US Department of Labor and provides commuter stipends, indicating a US-based requirement

Company

Scale AI provides the data foundation and full-stack technologies that power the world's leading AI models for enterprises and governments.

What you will do

• Design and deploy production AI agents leveraging LLMs, reasoning, retrieval, memory, and tool use.
• Architect intelligent systems combining LLMs with structured knowledge, enterprise data, and deterministic software.
• Develop multi-agent systems to coordinate reasoning, planning, tool execution, and human oversight.
• Design rigorous evaluation frameworks using A/B experiments, golden datasets, and LLM-as-a-Judge.
• Build production-quality systems with a strong emphasis on reliability, observability, latency, and safety.
• Partner directly with enterprise customers to translate ambiguous business problems into technical AI architectures.

Requirements

• 4+ years of software engineering, machine learning, or applied AI experience.
• Strong Python programming skills.
• Proven experience building production AI systems using LLMs.
• Proficiency with modern AI tooling including OpenAI, Claude, MCP, agent frameworks, or vector databases.
• Strong understanding of ML fundamentals and experience evaluating AI systems using quantitative metrics.
• Excellent communication skills for working directly with enterprise customers.

Nice to have

• Experience with RAG, semantic search, knowledge graphs, fine-tuning, or reinforcement learning.
• Experience building distributed production systems on cloud platforms (AWS, Azure, GCP).
• Proficiency with Docker, Kubernetes, CI/CD, and production observability.
• Experience leading technical workshops, architecture reviews, or customer design sessions.

Culture & Benefits

• Comprehensive health, dental, and vision coverage.
• Retirement benefits and generous PTO.
• Learning and development stipend.
• Commuter stipend for eligible roles.
• Inclusive and equal opportunity workplace.