Data Scientist, Codex (AI)

TL;DR

Data Scientist, Codex (AI): Measuring and accelerating product-market fit for AI developer tools with an accent on defining developer productivity and running experiments on coding models. Focus on designing A/B tests, operationalizing metrics, and diagnosing failure modes.

Location: Hybrid (3 days in the office per week in San Francisco, CA)

Company

hirify.global is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.

What you will do

• Embed with the Codex product team to discover opportunities that improve developer outcomes and growth
• Design and interpret A/B tests and staged rollouts of new coding models and product features
• Define and operationalize metrics such as suggestion acceptance, edit distance, compile/test pass rates, task completion, latency, and session productivity
• Build dashboards and analyses that help the team self-serve answers to product questions
• Diagnose failure modes and partner with Research on targeted improvements

Requirements

• 5+ years in a quantitative role at a developer-facing or high-growth product
• Fluency in SQL and Python; comfort with experiment design and causal inference
• Experience defining product metrics tied to user value
• Ability to communicate clearly with PM, Eng, and Design—and to influence product direction