QA & Test Automation Developer (AI)

Location: Remote or hybrid in Canada, with EST working hours

Salary: CAD 108,000–121,000 annual base salary, with potential bonus eligibility

Company

hirify.global develops AI-powered financial risk intelligence software for finance and audit professionals.

What you will do

• Design, develop, maintain, and scale automated test suites for modern software applications.
• Apply exploratory, risk-based, and heuristic testing to identify product risks, edge cases, failure modes, and behavioural gaps.
• Configure and use agentic tools to accelerate test creation, maintenance, analysis, failure triage, and coverage assessment.
• Improve the reliability, performance, and scalability of test frameworks, internal tooling, CI/CD pipelines, and automated quality gates.
• Develop testing strategies and evaluation methods for AI-powered, LLM-based, and agentic product capabilities.
• Collaborate with Engineering, Product, QA, and other technical teams to improve software quality and delivery speed.

Requirements

• Strong software testing fundamentals, critical thinking, exploratory testing, test design, risk-based testing, and product-impact reasoning.
• Hands-on experience designing and developing automated tests and working with modern test automation frameworks.
• Strong programming skills in at least one automation or engineering language, such as TypeScript, JavaScript, or Python.
• Experience with CI/CD pipelines and automated testing in software delivery workflows.
• Ability to troubleshoot complex failures across application, test, data, and infrastructure layers.
• Practical experience using AI-assisted development capabilities to improve engineering and QA workflows, plus strong collaboration and communication skills.

Nice to have

• Experience testing AI-powered applications, LLM features, copilots, or autonomous and agentic systems.
• Experience developing evaluation frameworks for non-deterministic AI behaviour.
• Familiarity with prompt evaluation, tool calling, grounding, retrieval-augmented generation, model evaluation, and LLM observability.
• Experience with large-scale end-to-end test suites, parallel execution, test data management, and distributed CI environments.

Culture & Benefits

• Work options include hybrid or remote arrangements.
• Health benefits and wellness programs.
• Professional development opportunities.
• Flexible time off and four company-wide digital detox days annually.
• Equity, competitive compensation, and company-matched retirement plans.