Staff AI Engineer (AI)

TL;DR

Staff AI Engineer (AI/Python): Building and scaling systems for AI evaluation and iteration to improve production AI agent performance with an accent on automated evaluation lifecycles and agent orchestration. Focus on designing internal platforms that reduce time-to-market for production-ready agents and implementing rigorous system design for non-deterministic LLM behaviors.

Location: Remote (HQ in Toronto, Canada)

Salary: CA$306,157 – CA$383,745

Company

hirify.global is an AI-first company building a unified AI agent platform to enable conversational commerce for ecommerce brands.

What you will do

• Architect and lead the development of an internal automated AI evaluation platform, transitioning from manual testing to a full lifecycle.
• Design tools and workflows to drastically reduce the time required to deliver calibrated, production-ready AI agents.
• Serve as the AI Technical Lead for product squads, providing guidance on agent design, failure analysis, and prompting best practices.
• Establish engineering metrics to translate non-deterministic AI behavior into predictable and trustworthy performance data.
• Mentor engineers on applying rigorous system design and reliability engineering to the world of LLMs and agents.
• Collaborate with the Orchestration team to build scalable infrastructure for complex evals and agentic simulations.

Requirements

• 8+ years of engineering experience with a strong background in distributed systems, internal platforms, or developer tooling.
• Deep expertise in architecting multi-stage AI orchestrations, including agents, chained workflows, and state management.
• Strong backend proficiency, with Python preferred.
• Experience with event-driven architectures and tools such as Kafka or Pub/Sub.
• Proven experience building scalable APIs and services with an obsession for reliability.
• Hands-on experience with LLMs, including prompting, RAG, and evaluation workflows.

Nice to have

• Experience with vector databases and semantic caching.
• Knowledge of monitoring, observability, and system performance for AI stacks.
• Experience building deterministic wrappers around probabilistic AI models.

Culture & Benefits

• 5-week vacation following the appropriate laws of your country.
• Comprehensive leave: paid sick leave and 16 weeks of paid parental leave.
• Financial security: private health insurance and RRSP matching up to 4%.
• Equipment and learning: MacBook Pro, $900 CAD home workstation stipend, and $2,600 CAD annual L&D budget.
• Team connection: Quarterly company-wide summits and annual team retreats.
• Onboarding: One-week invitation to the Toronto office with flights and accommodation covered.

Hiring process

• Initial stages: Recruiter phone screen followed by a Hiring Manager interview.
• Technical evaluation: System Design interview and a take-home AI Case Study (~1–2 hours).
• Final stages: Technical deep dive of the case study and a Leadership interview.