Staff Applied Scientist (AI Dashboards)

Location: Hybrid in New York, New York, USA

Salary: $276,000–$345,000 USD per year, plus equity and potential variable compensation.

Company

Datadog provides an observability platform for metrics, logs, and traces, with Dashboards serving as a unified interface for observability data.

What you will do

• Own the evaluation strategy for Dashboards and related teams, defining offline and online metrics for quality, cost, single-turn, and multi-turn experiences.
• Build evaluation datasets, golden traces, and regression harnesses for AI agents, dashboards, widgets, data sources, and visualizations.
• Improve retrieval relevance, tool-selection accuracy, and context efficiency in partnership with engineers.
• Define measurement systems that detect regressions across widget types and data sources, including grouping, sorting, and time overrides.
• Provide technical leadership through design reviews, working groups, and mentorship.

Requirements

• BS, MS, PhD in a scientific field, or equivalent experience.
• 10+ years of relevant engineering or applied science experience, including technical leadership.
• Proven experience leading ML or GenAI initiatives from research through production in a product-driven environment.
• Significant experience evaluating, experimenting with, or measuring ML systems at scale.
• Strong product mindset and experience driving cross-functional initiatives.
• Ability to make sound technical decisions in ambiguous environments.

Culture & Benefits

• Hybrid workplace focused on collaboration and work-life harmony.
• New-hire stock equity through RSUs and an employee stock purchase plan.
• Professional development, product training, and career pathing.
• Inclusive culture, giving programs, and employee resource groups through Community Guilds.
• Benefits may include healthcare, dental, parental planning, mental health support, 401(k) matching, paid time off, fitness reimbursement, and Spring Health benefits, depending on employment country and arrangement.