Staff Applied Scientist (AI)

TL;DR

Staff Applied Scientist (AI): Building and evaluating an AI-native control surface for observability dashboards with an accent on measurement systems, tool-selection accuracy, and retrieval relevance. Focus on developing end-to-end evaluation strategies for non-deterministic agents and ensuring system quality at scale.

Location: Hybrid in New York, New York, USA

Salary: $276,000 — $345,000 USD

Company

hirify.global is a leading observability and security platform that provides unified visibility across the technology stack to manage complexity at scale using AI.

What you will do

• Own the evaluation strategy for Dashboards and sister teams, defining offline and online quality and cost metrics.
• Build evaluation datasets, golden traces, and regression harnesses to detect quality changes before production.
• Drive measurable improvements to retrieval relevance, tool-selection accuracy, and context efficiency.
• Provide technical leadership through design reviews, working groups, and mentorship across the organization.

Requirements

• BS/MS/PhD in a scientific field or equivalent experience.
• 10+ years of relevant engineering or applied science experience, including time as a technical lead.
• Proven track record of leading ML or GenAI initiatives from research through production in a product-driven environment.
• Significant experience with evaluation, experimentation, or measurement of ML systems at scale.
• Strong product mindset and ability to drive initiatives across cross-functional teams.
• Must be based in New York, USA to support the hybrid office culture.

Culture & Benefits

• Competitive salary and equity package, including RSUs and an employee stock purchase plan (ESPP).
• Comprehensive healthcare, dental, parental planning, and mental health benefits.
• 401(k) plan and match.
• Continuous professional development, product training, and clear career pathing.
• Inclusive company culture with Community Guilds and various giving programs.