Frontier Agent Engineering Manager (AI)

Location: New York, NY

Salary: $227,000–$325,000 USD annually, plus potential equity and benefits.

Company

Scale AI provides data infrastructure, generative AI solutions, and enterprise AI capabilities for organizations building and deploying production AI applications.

What you will do

• Partner with enterprise customers to understand their infrastructure, data pipelines, and business requirements.
• Design and implement integrations with cloud platforms, data warehouses, internal APIs, and customer security environments.
• Build data connectors, ETL pipelines, production AI agents, multi-agent systems, evaluation frameworks, and human-in-the-loop workflows.
• Develop prompt strategies, prompt libraries, experimentation processes, A/B tests, RAG systems, and fine-tuning pipelines where appropriate.
• Lead the engineering team and collaborate with customer data scientists, ML engineers, software developers, and Scale product and engineering teams.
• Prototype solutions, debug issues across the stack, follow AI/ML research, and identify opportunities to productize recurring customer patterns.

Requirements

• 5+ years of software engineering experience and 3+ years of management experience.
• Strong fundamentals in data structures, algorithms, and system design.
• Production Python expertise and experience with modern ML/AI frameworks such as LangChain, LlamaIndex, HuggingFace, or the OpenAI API.
• Experience with AWS, GCP, or Azure and modern data infrastructure.
• Strong problem-solving skills, including the ability to navigate ambiguous requirements and rapidly iterate toward solutions.
• Excellent communication skills for explaining complex technical concepts to technical and non-technical audiences.

Nice to have

• Deep understanding of LLMs, prompting techniques, embeddings, and RAG architectures.
• Experience building and deploying AI agents or autonomous systems in production; knowledge of vector databases and semantic search systems.
• Contributions to open-source AI/ML projects.
• Experience with Docker, Kubernetes, CI/CD, and Terraform, Bicep, or other IaC tools.
• Previous experience in DevOps, platform, or infrastructure roles.
• Familiarity with enterprise security, compliance, and governance requirements such as SOC 2, GDPR, or HIPAA.
• Experience in technical consulting, solutions engineering, or product engineering with customers.
• Domain expertise in finance, healthcare, government, or manufacturing, and experience with technical enablement or teaching programs.

Culture & Benefits

• Full-time employment with comprehensive health, dental, and vision coverage.
• Retirement benefits, learning and development stipend, and generous paid time off.
• Eligible roles may include equity compensation and a commuter stipend.
• Inclusive equal opportunity workplace with reasonable accommodations for applicants with disabilities.

Hiring process

• Compensation is determined during the interview process based on location, skills, experience, qualifications, interview performance, and education or training.
• Candidates must wait 90 days before applying for reconsideration for the same role.