Senior Software Development Engineer in Test, ML

Location: Hybrid role based in Waterloo, Ontario, Canada or Madison, Wisconsin, USA

Salary: CAD 114,000–143,000 annual base pay for Ontario.

Company

hirify.global is the entertainment and technology brand of Sony Interactive Entertainment, delivering hardware, network services, and gaming experiences to more than 100 million people.

What you will do

• Lead architecture-level automation solutions and scalable quality engineering practices across multiple teams and product areas.
• Design, develop, and maintain automated test frameworks and scripts for ML inference services and related platform components using Python or Java.
• Create realistic test accounts and datasets, and validate model score distributions, ranking behavior, output quality, and other statistical signals before release.
• Perform functional, integration, regression, API, performance, and load testing for RESTful APIs, microservices, databases, and inference services.
• Partner with ML engineers and operations teams to ensure automated coverage for features and fixes within continuous integration and deployment workflows.
• Debug test failures and model anomalies, report defects, monitor test execution, and improve the performance and maintainability of test environments.

Requirements

• Bachelor’s degree in Computer Science or a related field.
• Minimum 5 years of experience as an SDET, including strong experience testing backend systems.
• Proficiency in Python, Java, Scala, or Go for test automation.
• Hands-on experience with API testing tools such as Postman for distributed systems.
• Familiarity with CI/CD pipelines and Jenkins or similar environments, including GitHub Actions or ArgoCD.
• Hands-on experience building and maintaining automated test frameworks such as pytest, JUnit, or TestNG.
• Experience working with databases for backend validation.
• Experience with cloud and container technologies such as AWS, GCP, Kubernetes, or Docker.
• Familiarity with monitoring and observability tools such as Prometheus, Grafana, or Datadog; strong understanding of SDLC and agile methodologies; excellent problem-solving and communication skills.

Nice to have

• Experience testing machine learning systems, including recommendation, search-ranking, or other probabilistic applications.
• Experience creating synthetic or seeded test data to simulate realistic customer or account behavior.
• Experience evaluating model outputs with statistical techniques, distribution analysis, or scenario-based validation.
• Knowledge of data pipelines, feature stores, inference systems, or model-serving infrastructure such as Seldon, KServe, or Ray Serve.
• Experience with performance and load testing tools, Databricks or similar ML platforms, and architecting CI/CD pipelines, quality gates, and release validation systems.

Culture & Benefits

• Hybrid working policy applies to the role, with base pay influenced by geographic location and job-related factors.
• Work within engineering teams spanning four continents and contribute to products used by millions of people.
• Inclusive environment focused on partnership, creative freedom, diverse perspectives, and practical technology solutions.
• Employment includes a background check at the offer stage, which may include a criminal background check for some roles.
• Sony is an equal opportunity and Fair Chance employer.