Senior Software Development Engineer in Test (ML)

Location: Hybrid role based in Madison, Wisconsin, United States or Waterloo, Ontario, Canada.

Salary: USD 152,000–190,000 base pay annually.

Company

hirify.global, part of Sony Interactive Entertainment, develops gaming hardware, network services, and entertainment experiences used by more than 100 million people worldwide.

What you will do

• Lead architecture-level automation solutions and scalable quality engineering practices across multiple teams and product areas.
• Design, develop, and maintain automated test frameworks and scripts for ML inference services and platform components using Python, Java, Scala, or Go.
• Create representative test accounts and datasets to evaluate model behavior across scenarios.
• Validate model score distributions, ranking behavior, output quality, thresholds, and other statistical signals before release.
• Perform functional, integration, regression, API, performance, and load testing for RESTful APIs, microservices, databases, and inference services.
• Partner with ML engineers and operations teams to expand automated coverage, debug failures and model anomalies, and support CI/CD and production readiness.

Requirements

• Bachelor’s degree in Computer Science or a related field.
• At least 5 years of experience as an SDET, including strong experience testing backend systems.
• Proficiency in Python, Java, Scala, or Go for test automation.
• Hands-on experience with API testing tools such as Postman for distributed systems.
• Familiarity with CI/CD pipelines and Jenkins or similar environments, including GitHub Actions or ArgoCD.
• Experience building and maintaining automated test frameworks such as pytest, JUnit, or TestNG.
• Experience working with databases for backend validation.
• Experience with cloud and container technologies such as AWS, GCP, Kubernetes, or Docker.
• Familiarity with monitoring and observability tools such as Prometheus, Grafana, or Datadog; understanding of SDLC and agile methodologies; excellent problem-solving and communication skills.

Nice to have

• Experience testing recommendation systems, search ranking systems, or other probabilistic ML applications.
• Experience creating synthetic or seeded test data for realistic customer and account behavior.
• Experience evaluating model outputs through statistical techniques, distribution analysis, or scenario-based validation.
• Knowledge of data pipelines, feature stores, inference systems, or model-serving infrastructure such as Seldon, KServe, or Ray Serve.
• Experience with performance and load testing tools, Databricks or similar ML platforms, and CI/CD quality gates and release validation systems.

Culture & Benefits

• Hybrid working policy with compensation determined partly by job-related factors and location.
• Medical, dental, and vision coverage.
• Matching 401(k), paid time off, wellness program, and employee discounts on Sony products.
• Potential eligibility for a bonus package.
• Inclusive, collaborative environment with engineering teams across four continents.

Hiring process

• Background checks are conducted at the offer stage and may include criminal background checks for some roles.
• Employment is subject to processing of personal information for the background-check process.