Sr. Software Development Engineer in Test (Agentic)

Location: Kitchener, Canada; based at one of hirify.global’s Canadian offices

Base salary for Ontario: $151,000–$175,000 CAD per year

Company

hirify.global provides an AI platform for customer experience, combining AI agents and human agents across voice and digital interactions.

What you will do

• Own end-to-end quality strategy, automation, execution, and release qualification for agentic features and workflows.
• Design and build automation tooling and frameworks for AI/LLM systems, prompt flows, agent orchestration, and tool integrations.
• Develop evaluation frameworks to measure response quality, accuracy, hallucination rates, task success, and other AI quality KPIs.
• Integrate deterministic and probabilistic quality checks into CI/CD pipelines, targeting 80%+ coverage for critical AI workflows and PR validation under 15 minutes.
• Build observability and debugging tools, including prompt tracing and response analysis, and perform performance and load testing for AI services.
• Partner with Applied AI teams, contribute to architecture reviews, mitigate safety and bias risks, and mentor engineers.

Requirements

• 6+ years of experience in software engineering or SDET roles with a strong software development focus.
• Strong programming skills in Python, Java, or JavaScript, with experience building scalable test frameworks and automation systems.
• Experience testing distributed, cloud-native SaaS systems and APIs, including CI/CD pipelines such as Jenkins or GitHub Actions.
• Hands-on experience with LLMs or AI/ML systems, non-deterministic systems, probabilistic testing, and AI evaluation techniques.
• Experience with relevant technologies including Google Cloud Platform, Cloud Run or App Engine, Kubernetes, Datastore, Redis, Elasticsearch, Vue 3, React, LiveKit, and prompt orchestration frameworks.
• Bachelor’s degree in Computer Science or equivalent practical experience, with strong collaboration skills across distributed teams and time zones.

Culture & Benefits

• Work on agentic AI products for business communications and customer experience.
• Competitive salary, comprehensive benefits, and opportunities for professional growth.
• Access to AI tools, a robust training program, and an inclusive office environment designed for collaboration.
• Culture centered on curiosity, persistence, optimism, empathy, and high standards.