Product Data Scientist (AI)

TL;DR

Product Data Scientist (AI): Owning and extending the evaluation loop for AI financial products with an accent on quality metrics, regression testing, and production feedback loops. Focus on building robust evaluation suites, maintaining online quality dashboards, and translating analytical insights into actionable product decisions.

Location: Must be based in Europe (Remote or Hybrid model available).

Company

hirify.global is a European fintech startup building an all-in-one financial platform for entrepreneurs, integrating banking, accounting, and invoicing.

What you will do

• Own and extend the offline evaluation suite, including datasets, judges, and metrics.
• Build and maintain online quality dashboards to track resolution rates, latency, and CSAT.
• Mine failure patterns from production traffic to create regression cases and propose improvements.
• Harden evaluation methodology by managing judge stability and non-determinism.
• Translate complex data into clear product decisions through weekly syncs and trade-off analysis.

Requirements

• Must be based in Europe.
• 3+ years of experience in analyst or data scientist roles, with at least one year in a product context.
• Proficiency in Python and SQL for end-to-end analysis.
• Solid foundation in statistics, including sampling, hypothesis testing, and variance.
• Analytical mindset focused on business outcomes rather than just tools.

Nice to have

• Experience in quality analytics for ML systems (ranking, recommendations, classification).
• Hands-on experience evaluating LLM applications (RAG, agents, tool use).
• Experience building LLM agents through side projects or experiments.

Culture & Benefits

• Stock Options Program available to all team members.
• Flexible remote and hybrid work model across Europe.
• Work & Swim program: opportunity to spend one month in a corporate apartment in Cyprus.
• Modern, friendly, and eco-conscious corporate culture.
• Emphasis on AI-assisted coding as the default environment.