Senior QA Engineer (AI)

Location: Vancouver, Canada. In-office attendance is required twice weekly on Mondays and Wednesdays.

Company

hirify.global develops Calico, a network security and observability platform for Kubernetes clusters, and Lynx, a product for detecting and evaluating AI-agent behaviour at runtime.

What you will do

• Own the test strategy across unit, integration, end-to-end, and non-functional testing.
• Design automated test suites, CI pipelines, tooling, fixtures, and synthetic data.
• Test distributed Kubernetes-native systems, multi-node clusters, telemetry pipelines, APIs, and backend services under realistic load and failure conditions.
• Validate ML-driven detections, risk scores, and behavioural baselines using regression testing, ground-truth datasets, and false-positive/false-negative analysis.
• Investigate defects, isolate root causes, and drive issues to resolution with engineering.
• Define release-readiness criteria and represent quality in design and release decisions.

Requirements

• 5+ years of software QA or test engineering experience, with a strong focus on automation.
• Proficiency in at least one test-automation programming language; Python is preferred.
• Hands-on experience testing distributed systems, APIs, and backend services.
• Working knowledge of containers and Docker.
• Experience building and maintaining CI/CD pipelines with integrated automated tests.
• Strong debugging, root-cause analysis, and written and verbal communication skills; comfort with and advocacy for AI tooling.

Nice to have

• Experience testing AI-powered applications or AI/ML systems, including prompt and agent testing, LLM evaluation, RAG validation, hallucination and safety testing, or AI regression testing.
• Working knowledge of Kubernetes and cluster operations.
• Experience with observability and telemetry pipelines, including metrics, logs, traces, ClickHouse, or Prometheus.
• Performance, load, or chaos testing experience.
• Exposure to eBPF, kernel telemetry, runtime security tooling, or open-source testing and infrastructure projects.

Culture & Benefits

• Small, autonomous engineering team working closely with Lynx engineering leadership.
• Opportunity to establish quality practices for a new product from the ground up.
• Claude Code is expected for internal development and testing workflows.
• Collaborative and flexible work environment focused on respect, openness, and teamwork.
• Full health, vision, and dental benefits with competitive compensation.