Data Scientist (LLM/AI)

TL;DR

Data Scientist (LLM/AI): Developing and optimizing LLM-powered conversational experiences for an AI-driven search and shopping assistant with an accent on instruction design, contextual grounding, and evaluation frameworks. Focus on leveraging scientific rigor and product intuition to improve LLM quality, robustness, and customer impact at Amazon scale.

Location: Onsite in London, UK

Company

hirify.global is focused on building industry-leading language technology powering Rufus, their AI-driven search and shopping assistant, to help customers with their shopping tasks.

What you will do

• Develop and maintain LLM instruction iterations and evaluation frameworks, including automated eval pipelines and dataset curation.
• Perform hands-on analysis of large-scale multimodal interaction datasets to develop insights into customer engagement with conversational AI systems.
• Design and analyze A/B tests and experiments to evaluate new features and model improvements.
• Develop metrics, dashboards, and reporting frameworks to monitor system performance and customer engagement.
• Conduct deep-dive analyses to identify opportunities for improving conversational relevance and customer satisfaction.
• Collaborate with Applied Scientists and Engineers to translate analytical insights into production systems.

Requirements

• Master's degree or above in Math, Statistics, Computer Science, or related science field.
• Experience with machine learning/statistical modeling data analysis tools and techniques.
• Experience in a ML or data scientist role with a large technology company.
• Experience with data scripting languages (e.g. SQL, Python, R) or statistical/mathematical software.
• Experience effectively communicating complex concepts through written and verbal communication.
• Must be based in London, UK.

Nice to have

• Experience with AWS services including S3, Redshift, Sagemaker, EMR, Kinesis, Lambda, and EC2.
• Experience in defining and creating benchmarks for assessing GenAI model performance.
• Experience working on multi-team, cross-disciplinary projects.

Culture & Benefits

• An equal opportunities employer committed to employing a diverse workforce.
• Inclusive culture empowering employees to deliver the best results.
• Workplace accommodation or adjustment available for disabilities during the application and hiring process.