Senior Data Analyst (AI)

TL;DR

Senior Data Analyst (AI/Search): Leading analytics and evaluation for search and retrieval systems to improve ranking quality and user experience with an accent on search evaluation metrics and A/B testing. Focus on designing experimentation frameworks, analyzing query behavior, and integrating GenAI-powered features.

Location: London Wall, UK

Company

Global leader in information and analytics providing trusted content and data to researchers, clinicians, and life sciences professionals.

What you will do

• Lead the analysis of search and retrieval system performance, specifically focusing on ranking quality and relevance.
• Define and standardize search evaluation metrics including NDCG, MAP, recall, and precision.
• Design and lead A/B testing and experimentation frameworks for ranking and search improvements.
• Develop and evolve dashboards and reporting systems to track search performance and user engagement.
• Collaborate with engineering to improve logging, tracking, and observability of search systems.
• Translate complex data into actionable insights and storytelling for technical and business stakeholders.

Requirements

• Master's or PhD in Data Analytics, Statistics, Computer Science, or a related field.
• Significant experience in data analysis, business intelligence, or analytics roles.
• Proficiency in SQL and Python for large-scale data analysis.
• Advanced experience with BI tools (Tableau, Power BI, Looker) and Databricks or similar platforms.
• Deep understanding of experimentation design, A/B testing, and statistical analysis.
• Experience defining and analyzing search/retrieval metrics such as NDCG, recall, and precision.

Nice to have

• Experience working on search, ranking, or recommendation systems.
• Familiarity with information retrieval concepts like indexing and query understanding.
• Exposure to clickstream data, user behavior analytics, and event tracking.
• Experience with RAG systems or GenAI applications.

Culture & Benefits

• Flexible working hours to promote a healthy work-life balance.
• Comprehensive health benefits including private medical insurance and health screenings.
• Competitive contributory pension scheme and share option schemes.
• Generous parental leave and paid time off for carers.
• Access to sabbatical options and support for personal and work-related challenges.