Data Scientist (AI)

TL;DR

Data Scientist (AI): Developing next-generation metrics and quality control systems for the Bing Grounding API with an accent on RAG quality and LLM-as-a-judge evaluation pipelines. Focus on designing complex end-to-end data pipelines, implementing prompt engineering strategies, and generating actionable insights for large-scale search relevance.

Location: Must be based in the U.S. and be able to commute to a Microsoft office at least four days per week.

Salary: $100,600 – $215,400 per year, depending on location.

Company

hirify.global focuses on empowering individuals and organizations through cutting-edge AI technologies and innovation.

What you will do

• Design and implement metrics for RAG (Retrieval-Augmented Generation) within Bing Search.
• Build scalable pipelines and dashboards for monitoring Bing Grounding quality.
• Utilize LLMs in "judge" settings for automated search result evaluation.
• Engineer prompts to optimize data processing and insight generation.
• Create end-to-end automated pipelines for anomaly detection and quality reporting.
• Apply classical ML techniques combined with LLMs to augment data analysis.

Requirements

• Location: Must be based in the United States and able to commute to an office.
• Degree in Data Science, Mathematics, Statistics, Computer Science, or related field.
• Professional experience in data science, including managing structured/unstructured data.
• Proficiency in major programming languages like Python or C#.
• Solid experience with SQL and data visualization techniques.
• Ability to work independently within a distributed, international team.

Nice to have

• 5+ years of programming experience in Python, C#, or Java.
• Deep interest or practical experience with RAG and Large Language Models.
• Passion for designing novel data visualization dashboards.
• Experience with advanced machine learning techniques.

Culture & Benefits

• Commitment to a culture of inclusion and growth mindset.
• Hybrid work model with a strong focus on team collaboration.
• Access to competitive industry benefits and compensation packages.
• Opportunity to influence global-scale search engine technologies.