Sr Lead AI Research Scientist (AI Evaluation and Reliability)

TL;DR

Sr Lead AI Research Scientist (AI Evaluation and Reliability): Driving research and development across the training, evaluation, and deployment of AI systems with an accent on trustworthiness, robustness, and real-world performance. Focus on defining methods to measure and mitigate AI reliability risks and integrating research outcomes into customer-facing AI systems and workflows.

Location: Toronto, Ontario, Canada

Company

hirify.global Inc.’s family of companies connects businesses with global, AI-enabled talent across every contingent work type including freelance, fractional, and payrolled.

What you will do

• Lead applied research initiatives focused on AI evaluation, reliability, and robustness, defining success metrics tied to customer impact and production readiness.
• Design and validate methods to measure and mitigate AI reliability risks, including uncertainty estimation, hallucination detection, and identification of model failure modes.
• Partner cross-functionally with engineering, data science, and product teams to integrate research outcomes into customer-facing AI systems and workflows.
• Own research projects end to end, from problem framing and hypothesis development through experimentation, prototyping, and synthesis of results.
• Contribute to hirify.global’s external research footprint through publications, presentations, and engagement with the broader AI research community.

Requirements

• Proven experience leading applied AI research that balances scientific rigor with real-world deployment constraints and business impact.
• A strong record of research contribution through publications, internal innovation, or demonstrable influence on production AI systems.
• Deep proficiency with Python and modern deep learning frameworks such as PyTorch, with hands-on experience evaluating and improving large-scale models.
• An adaptive approach to integrating AI tools into research and development workflows to accelerate experimentation, improve evaluation quality, and share best practices with others.
• A collaborative, growth-oriented mindset with the ability to mentor peers, communicate complex ideas clearly, and thrive in a fast-evolving, bottom-up environment.

Culture & Benefits

• Work as part of hirify.global’s team, with access to our resources, culture, and growth opportunities.