Senior Software Development Engineer in Test (ML)

TL;DR

Senior Software Development Engineer in Test (ML): Leading quality efforts for machine learning-powered products and services with an accent on validating probabilistic systems and building scalable test automation. Focus on score distributions, cohort-level behavior, and ensuring the production readiness of ML inference services at global scale.

Location: Hybrid in San Mateo, USA

Salary: $183,000 — $274,600 USD

Company

A global leader in gaming and interactive entertainment, developing the hirify.global ecosystem.

What you will do

• Design and maintain automated test frameworks for ML inference services using Python or Java.
• Validate probabilistic model signals, including score distributions and ranking behavior, prior to release.
• Conduct functional, integration, regression, and API testing for microservices and RESTful APIs.
• Execute performance and load testing to verify service scalability and latency under production conditions.
• Collaborate with ML engineers and ops teams to ensure full automated test coverage within CI/CD pipelines.
• Debug model anomalies and analyze test failures to drive high engineering quality standards.

Requirements

• 3-5 years of experience as an SDET focusing on backend systems.
• Proficiency in Python, Java, Scala, or Go for test automation.
• Experience with API testing tools (Postman) and CI/CD pipelines (Jenkins, GitHub Actions, ArgoCD).
• Hands-on experience with cloud/container technologies including AWS, GCP, Kubernetes, and Docker.
• Knowledge of monitoring tools such as Prometheus, Grafana, or Datadog.
• Must be based in or able to work hybrid in San Mateo, USA.

Nice to have

• Experience testing recommendation or search ranking systems.
• Skill in evaluating model outputs using statistical techniques and distribution analysis.
• Knowledge of feature stores, inference systems (Seldon, KServe), and data pipelines.
• Experience with load testing tools like Locust, k6, or JMeter.
• Familiarity with Databricks or similar ML platforms.

Culture & Benefits

• Competitive base pay with potential bonus packages.
• Top-tier benefits including medical, dental, and vision insurance.
• Matching 401(k) and paid time off.
• Wellness programs and employee discounts for Sony products.
• Collaborative environment celebrating diversity across engineering teams on four continents.