Senior Software Development Engineer in Test (Agentic)

Location: Based at one of hirify.global’s Canadian offices; Vancouver, Canada

Salary: $150,500–$175,250 CAD per year base salary for British Columbia, excluding bonus, equity, and benefits.

Company

hirify.global is an AI platform for customer experience that uses voice and digital AI agents to resolve customer problems and turn conversations into insight and action.

What you will do

• Own end-to-end quality strategy, automation, execution, and release qualification for agentic features and workflows.
• Build automation tooling and test frameworks for AI/LLM systems, prompt flows, agent orchestration, and tool integrations.
• Develop evaluation frameworks to measure response quality, accuracy, task success, and hallucination rates.
• Integrate deterministic and probabilistic AI quality checks into CI/CD pipelines, targeting 80%+ coverage for critical workflows and under 15-minute PR validation.
• Build LLM observability and debugging tools, including prompt tracing and response analysis.
• Design performance and load tests, mitigate hallucination, bias, safety, and edge-case risks, and mentor engineers on AI quality practices.

Requirements

• 6+ years of software engineering or SDET experience with a strong software development focus.
• Strong programming skills in Python, Java, or JavaScript, plus experience building scalable test automation frameworks.
• Experience testing distributed, cloud-native SaaS systems and APIs, and working with CI/CD pipelines such as Jenkins or GitHub Actions.
• Hands-on experience with LLMs or AI/ML systems, non-deterministic systems, probabilistic testing, and AI evaluation techniques.
• Experience with backend technologies including Go, Google Cloud Platform, Cloud Run or App Engine, Kubernetes, Datastore, Redis, and Elasticsearch; frontend experience with Vue 3 or React.
• Bachelor’s degree in Computer Science or equivalent practical experience, with the ability to collaborate across distributed teams and time zones.

Culture & Benefits

• Work on agentic AI products for business communications and customer experience.
• Access to AI tools designed to amplify employee impact.
• Competitive salary and comprehensive benefits.
• Training programs and opportunities for professional growth.
• Inclusive offices designed to support collaboration and connection.