Senior Software Development Engineer in Test (AI/ML)

Location: Waterloo, Ontario, Canada; other location: Madison, Wisconsin, USA. The role may follow a hybrid working policy.

Base pay: $114,900–$172,300 CAD.

Company

hirify.global is the entertainment and technology brand of Sony Interactive Entertainment, delivering hardware, network services, and interactive entertainment experiences.

What you will do

• Define quality strategies, test plans, and automation coverage for ML-powered services and platform components.
• Use LLMs and AI-assisted techniques to generate, expand, and maintain test cases for AI-powered workflows.
• Design scenario-based test suites covering adversarial prompts, edge cases, ambiguous inputs, and underrepresented user scenarios.
• Lead quality engineering for cross-functional projects, including risk assessment, dependency management, and release readiness.
• Develop scalable automation frameworks and automated validation for backend services, APIs, distributed systems, and ML inference outputs.
• Debug failures, model inconsistencies, and AI regressions while improving automation reliability and integrating testing into CI/CD workflows.

Requirements

• Bachelor’s degree in Computer Science or equivalent.
• 5+ years of experience as an SDET or QE engineer focused on backend and distributed systems.
• Experience using LLMs to generate, transform, and prioritize test cases for AI-powered experiences.
• Experience with AI evaluation tooling, prompt evaluation frameworks, model monitoring, or human-in-the-loop review workflows.
• Strong experience testing RESTful APIs, microservices, and distributed architectures.
• Proficiency in Python, Java, JavaScript, or similar languages for automation development.
• Hands-on experience with automation frameworks such as pytest, JUnit, Selenium, Playwright, Cypress, or Appium.
• Experience with CI/CD systems and test pipelines, including Jenkins or GitHub Actions.
• Experience with cloud and container technologies such as AWS, GCP, Kubernetes, and Docker.
• Familiarity with databases, monitoring, observability tools, SDLC, Agile methodologies, and release processes, plus strong problem-solving, debugging, and communication skills.

Nice to have

• Experience validating ML outputs using statistical analysis or scenario-based testing.
• Familiarity with ML infrastructure, data pipelines, or model-serving platforms such as Seldon, KServe, or Ray Serve.
• Experience in content moderation ML, security, fraud detection, or adversarial ML.
• Experience testing high-scale, low-latency online services or using Databricks or similar ML platform tooling.
• Familiarity with Node.js, React, or modern frontend technologies.
• Experience testing mobile, console, or other non-PC platforms.

Culture & Benefits

• Collaborative, curious environment focused on delivering practical quality and security value.
• Medical, dental, and vision coverage.
• Matching 401(k), paid time off, wellness program, and employee discounts for Sony products.
• Potential eligibility for a bonus package.
• Inclusive equal-opportunity workplace with fair-chance hiring practices.

Hiring process

• Background checks are conducted at the offer stage and may include criminal background checks for some roles.