Data Scientist/Engineer (AI)

TL;DR

Data Scientist/Engineer (AI): Deriving and validating online signals from user interactions to measure and improve answer quality in an LLM-first search engine with an accent on designing novel online metrics and building data pipelines at scale. Focus on analyzing experimental results to validate metrics and ensuring alignment with ground-truth evaluations.

Location: London, Berlin, Belgrade (Hybrid)

Company

hirify.global serves tens of millions of users daily with reliable, high-quality answers grounded in an LLM-first search engine and specialized data sources.

What you will do

• Discover and validate online signals from user interactions that serve as reliable proxies for true answer quality.
• Design and implement novel online metrics to be tracked in A/B testing and on product health dashboards.
• Analyze experimental results to validate these metrics, ensuring they accurately predict user satisfaction.
• Build and maintain data pipelines that calculate these metrics at scale, delivering actionable quality signals.
• Communicate findings and collaborate closely with Product and Search teams.
• Operate in a small, high-impact team where your work directly shapes Answer Quality.

Requirements

• MS in a technical field or equivalent experience.
• 4+ years of experience working as a Data Scientist, Analytics Engineer, or related role.
• Experience working on search, recommendation, or LLM-based products, with an emphasis on designing online metrics and analyzing A/B experiments.
• Strong proficiency in Python and SQL (expected to write production-grade code).
• Deep knowledge of statistical analysis.
• Experience with Business Intelligence (BI) tools for visualization and reporting.

Nice to have

• Proficiency with Apache Spark and Databricks.
• Experience with the development or validation of LLM-as-a-judge systems.
• Prior work supporting customer-facing products at scale.

Culture & Benefits

• Work in a small, high-impact team directly shaping product improvement.
• Comfortable with agentic coding workflows and using AI-assisted development tools.