Senior QA Engineer (AI)

Location: Remote; aligned with UK working hours

Company

hirify.global rebuilds vertical software businesses around AI, including EPOWERdoc, a SaaS emergency department information system for hospitals.

What you will do

• Own the end-to-end QA strategy, release quality gates, risk-based coverage, and quality metrics.
• Architect and document the testing stack for web applications, APIs, integrations, performance, accessibility, and security.
• Build scalable Playwright automation for clinical workflows including triage, documentation, orders, and discharge.
• Develop load, stress, and soak tests for emergency department peak volumes and integrate automated suites into CI/CD pipelines.
• Design AI evaluation harnesses, golden datasets, scoring rubrics, regression gates, and safety guardrails.
• Partner with engineering, product, design, and clinical experts on exploratory testing, defect resolution, and release readiness.

Requirements

• 5+ years of professional QA or software testing experience, including at least 3 years building test automation.
• Strong TypeScript or JavaScript skills and working proficiency in Python.
• Hands-on experience building scalable automation frameworks; Playwright is strongly preferred, with Cypress or Selenium also considered.
• Daily experience using AI coding agents and understanding of LLM evaluation, non-deterministic outputs, grading, and pass thresholds.
• Experience with performance testing tools such as Locust, k6, or JMeter, plus API testing, CI/CD, and Git.
• Experience working remotely in fast-paced agile environments across time zones and communicating quality risks clearly.

Nice to have

• Healthcare or health-tech experience, especially EHR, EDIS, regulated clinical software, HL7 v2, FHIR, or HIPAA testing requirements.
• Experience with LLM evaluation and observability tools, MCP servers, or custom AI agents.
• Security, prompt-injection, red-team, accessibility, or WCAG testing experience.

Culture & Benefits

• Remote work with collaboration across a global team.
• Flexible remote work options and compensation aligned with UK working hours.
• Training programs and opportunities for long-term career progression.
• Comprehensive health benefits.