QA Manager (AI)

TL;DR

QA Manager (AI/SaaS): Leading the quality engineering function for a SaaS platform with an accent on modern testing automation and developer enablement. Focus on designing validation strategies for non-deterministic AI/LLM systems and optimizing CI/CD pipelines for scalability.

Location: Hybrid: Must work 3 days a week in the Toronto office

Salary: $110,000 – $135,000 CAD per year

Company

hirify.global provides cutting-edge technology in accounting and financial reporting, building impactful software solutions.

What you will do

• Recruit and lead a team of SDETs to embed quality into all development phases through tooling, automation, and best practices.
• Define and execute a scalable quality strategy for a SaaS platform, focusing on shifting testing left and strengthening contract coverage.
• Design validation methods for non-deterministic AI/LLM systems using golden datasets, LLM-as-judge, and synthetic test generation.
• Optimize CI/CD pipelines for speed and reliability, implementing meaningful quality gates to reduce flakiness.
• Establish frameworks for performance, scalability, and resilience testing, including testing-in-production approaches.
• Oversee platform release management and drive scalable, regulatory-compliant test data management strategies.

Requirements

• 7+ years' experience leading QA or quality engineering teams in cloud-native SaaS environments (AWS).
• Expertise in scaling automated testing infrastructure and integrating with modern CI/CD pipelines (GitHub Workflows).
• Proficiency in the testing pyramid, including experience with Cypress, Pact, and K6.
• Strong technical knowledge of frontend (HTML/CSS/JS/TS) and backend (RESTful APIs).
• Experience testing non-deterministic systems such as LLM applications or statistical algorithms.
• Hands-on familiarity with observability tools like New Relic to improve test signal and feedback loops.

Nice to have

• Experience applying AI tools for test generation, defect prediction, or intelligent automation.
• Experience integrating QA tools like Zephyr Scale.

Culture & Benefits

• Collaborative and inclusive team culture where ideas are valued and knowledge sharing is encouraged.
• Flexible work options and generous time-off policies to ensure work-life balance.
• Competitive compensation with comprehensive health insurance and retirement plans.
• Recognition programs, performance bonuses, and clear opportunities for career growth.
• Exposure to international projects and collaboration with a diverse global team.