Manager II, Engineering - AI Platform Training, Serving and Storage (NorAm) (AI)

TL;DR

Engineering Manager II (AI Platform): Leading the development of AI infrastructure for large-scale training and inference with an accent on serving and storage systems. Focus on managing a multi-team organization, integrating Open Source Tooling like Ray, and delivering high-quality software within an early-stage project cycle.

Location: Hybrid (New York, NY, USA)

Salary: $234,000 — $300,000 USD

Company

Datadog provides AI infrastructure tools and platforms that enable data scientists and engineers to conduct large-scale training and inference.

What you will do

• Lead a fast-growing organization of approximately 20 people across multiple teams.
• Define the technical roadmap and strategic direction for AI training, serving, and storage.
• Collaborate with product managers and engineering teams to shape the future of the AI platform.
• Build and maintain a strong organizational culture centered on engineering standards and customer focus.
• Oversee the full AI development lifecycle, including model training, serving, deployment, and monitoring.

Requirements

• Experience leading teams that built 0 to 1 ML/AI Platforms.
• Strong expertise in Open Source Tooling, specifically Ray or AnyScale.
• Proven track record of managing other managers and high-performing software engineering teams.
• Ability to drive delivery and make an impact within ambiguous, early-stage project environments.
• Must be based in New York, NY, USA to support a hybrid work model.

Culture & Benefits

• Equity package including new hire RSUs and an employee stock purchase plan (ESPP).
• Comprehensive global benefits, including healthcare, dental, and mental health support.
• 401(k) plan with company match.
• Professional development through product training, career pathing, and a mentor/buddy program.
• Inclusive culture with access to Community Guilds and Internal panel discussions.