Senior Test Automation Engineer (AI)

Location: Remote anywhere in the United States; San Francisco onsite option requires working from the office four days per week.

Salary: $150K–$185K annually

Company

hirify.global develops AI-powered radiology solutions that reduce reporting errors, support radiologists, and improve patient care using proprietary radiology data and generative AI.

What you will do

• Own test automation strategy for a product domain and design scalable frameworks, fixtures, and utilities used by engineers.
• Plan high-risk releases, build test matrices across integrations, environments, and customer workflows, and define release go/no-go signals.
• Validate radiologist workflows across Windows, Electron, dictation systems, and PACS/RIS integrations, combining automation with exploratory testing.
• Improve test signal quality by reducing flakiness and runtime, stabilizing test data and environments, and triaging failures.
• Lead or co-lead performance, load, security, accessibility, compliance, and AI system testing, including evaluations of non-deterministic outputs.
• Use incident and defect data to expand regression coverage, track quality metrics, mentor engineers, and support quality-related hiring and onboarding.

Requirements

• 6+ years of software engineering or test automation experience, including 3+ years designing and owning automation frameworks.
• Strong programming skills in TypeScript and/or Python.
• Deep experience with end-to-end frameworks such as Playwright, Selenium, or Cypress.
• API testing experience with REST and GraphQL services, including data and downstream dependency interactions.
• Experience integrating tests into CI/CD pipelines such as GitHub Actions or CircleCI, including PR-level gating, parallelization, and reporting.
• Evidence of reducing test flakiness and suite runtime using data.
• Experience with risk-based test strategy for integration-heavy systems across multiple customer configurations.
• Strong debugging skills across services, data, and environments, with working knowledge of SQL, logs, and observability tools.
• Experience helping developers own their tests, using AI tools to create, maintain, and triage tests, and reviewing their output; clear communication, collaboration, mentoring, and influence without authority.

Nice to have

• Healthcare or other regulated-environment experience, including HIPAA, PHI, or SOC 2, ideally in a startup.
• Familiarity with PACS, RIS, dictation platforms, HL7/FHIR, FHIRcast, or DICOM.
• Experience automating Windows desktop or Electron applications with tools such as WinAppDriver or UI Automation.
• Experience testing ML, AI, or speech systems with non-deterministic outputs.
• Performance or load testing experience and security checks integrated into pipelines.
• Experience with AWS or Google Cloud, Docker, Terraform, Testmo, or Grafana quality dashboards.

Culture & Benefits

• Engineering owns quality, while Quality owns the quality system, with close collaboration across product and engineering teams.
• US-based full-time employees receive medical, dental, vision, and life insurance; HSA with employer match; FSA and DCFSA; and a 401(k).
• Benefits include 11 paid company holidays, flexible PTO, an annual equipment stipend, and annual and periodic team offsites.
• hirify.global supports transparency, inclusion, and collaboration and provides equal employment opportunities.

Hiring process

• Apply through hirify.global's official careers page; candidates should be vigilant regarding job scams and use official recruiter domains.