QA Lead (AI/Healthtech)

Location: Ukraine; remote or hybrid work available.

Company

hirify.global is supporting a founder-led US healthtech startup building an AI-powered mobile app for caregivers of children with complex medical needs.

What you will do

• Own the end-to-end QA process, including release baselines, go/no-go decisions, quality metrics, and residual-risk records.
• Rebuild and tier the regression suite, maintain an authoritative test repository, and trace requirements to tests and defects in high-risk areas.
• Test AI features through evaluation datasets, hallucination checks, exact-number recall, profile attribution, and caregiver context isolation.
• Define regression triggers for prompt, model, and configuration changes.
• Drive mobile and web test automation, own the Maestro baseline for Flutter iOS and Android, and maintain CI pipeline reliability.
• Mentor the QA team and embed AI-assisted workflows for test generation, regression analysis, defect investigation, and reporting.

Requirements

• 5+ years of QA experience, including at least 2 years owning the QA process for a product.
• Strong risk-based test design skills, including permission and role matrices, negative scenarios, and state transitions.
• Hands-on experience testing LLM or AI features, including evaluation datasets, hallucination checks, non-deterministic output, and prompt or model regressions.
• Practical experience with mobile automation, web automation, and CI pipeline integration.
• Experience with API testing, Jira, Confluence, and basic SQL.
• English B2+ required for test documentation, stakeholder communication, and release-risk discussions.

Nice to have

• Experience with Maestro, Appium, Detox, Flutter integration tests, Playwright, or Cypress.
• Familiarity with FHIR, HIPAA, or healthcare data standards and compliance.
• Experience with Langfuse, promptfoo, Ragas, or DeepEval.
• Daily practical use of AI tools such as Claude across QA workflows.

Culture & Benefits

• Remote or hybrid work with a flexible approach to time off and personal days.
• Professional training and development opportunities aligned with career goals.
• Access to an in-house English tutor.
• Referral and recognition reward programs.
• Birthday, wedding, and new-family-member perks, plus invoicing assistance, tech administration support, and People Partnership.