Senior Software Development Engineer in Test, ML

Location: Madison, Wisconsin, US, or Waterloo, Ontario, Canada; hybrid working policy applies

Salary: $152,000–$190,000 USD base pay annually, with possible bonus eligibility.

Company

Build performant PlayStation products and tools used by millions of customers worldwide, with engineering teams across four continents.

What you will do

• Drive architecture-level automation solutions and scalable quality engineering practices across teams and product areas.
• Design, develop, and maintain automated frameworks and scripts for ML inference services and platform components using Python, Java, Scala, or Go.
• Create realistic test accounts and datasets, and validate model scores, ranking behavior, output quality, and statistical signals before release.
• Perform functional, integration, regression, API, performance, and load testing for RESTful APIs, microservices, databases, and inference services.
• Partner with ML engineers, software engineers, product managers, data partners, and operations teams to ensure automated coverage for features and fixes.
• Debug test failures and model anomalies, report defects, monitor test execution, and optimize test environments and quality practices.

Requirements

• Bachelor’s degree in Computer Science or a related field.
• At least 5 years of SDET experience, including strong backend systems testing experience.
• Proficiency in Python, Java, Scala, or Go for test automation.
• Hands-on experience with API testing tools such as Postman for distributed systems.
• Familiarity with CI/CD pipelines and Jenkins or similar environments, including GitHub Actions or ArgoCD.
• Hands-on experience building and maintaining automated test frameworks such as pytest, JUnit, or TestNG.
• Experience working with databases for backend validation.
• Experience with cloud and container technologies such as AWS, GCP, Kubernetes, or Docker.
• Familiarity with monitoring and observability tools such as Prometheus, Grafana, or Datadog; strong understanding of SDLC and agile methodologies; excellent problem-solving and communication skills.

Nice to have

• Experience testing machine learning systems, including recommendation, search ranking, or other probabilistic applications.
• Experience creating synthetic or seeded test data and evaluating model outputs with statistical techniques, distribution analysis, or scenario-based validation.
• Knowledge of data pipelines, feature stores, inference systems, or model-serving infrastructure such as Seldon, KServe, or Ray Serve.
• Experience with performance and load testing tools, Databricks or similar ML platforms, and architecting CI/CD pipelines, quality gates, or release validation systems.

Culture & Benefits

• Collaborative engineering environment where input is valued and members have creative freedom.
• Benefits include medical, dental, and vision coverage, matching 401(k), paid time off, wellness programs, and Sony employee discounts.
• Hybrid working policy applies; base pay varies according to market, geographic location, knowledge, skills, experience, and other job-related factors.