Senior Research Scientist (AI)

TL;DR

Senior Research Scientist (AI): Develop next-generation evaluation benchmarks and infrastructure to measure LLM progress with an accent on creating ambitious evaluation methods and scalable tools. Focus on designing trustworthy, repeatable evaluations, advancing LLM evaluation research, and building efficient data synthesis pipelines.

Location: Hybrid in Toronto, New York, Seattle, San Francisco, London, United States, Canada

Company

hirify.global is a leading AI company focused on training and deploying frontier models for developers and enterprises to power advanced AI experiences like content generation and semantic search.

What you will do

• Create ambitious new evaluation benchmarks pushing model capabilities.
• Collaborate cross-functionally to translate model feedback into reliable evaluations.
• Conduct research to advance LLM evaluation methods including training LLM judges and refining data synthesis.
• Build scalable, reusable tools to analyze model performance.

Requirements

• Location: Hybrid work in specified cities across US, Canada, and UK
• English: B2 or higher proficiency required
• Strong software engineering skills.
• Experience in building prototypes demonstrating LLM capabilities.
• Attention to data quality and rigorous AI capability measurement.

Culture & Benefits

• Inclusive and open culture with a focus on diversity.
• Work with cutting-edge AI research teams.
• Weekly lunch stipend, in-office lunches, and snacks.
• Full health and dental benefits including mental health budget.
• 100% parental leave top-up for up to 6 months.
• Personal enrichment benefits and 6 weeks vacation.
• Remote-flexible with offices in multiple major cities and co-working stipend.