Senior Manager, Test Automation & AI Evaluation (Healthcare)

TL;DR

Senior Manager, Test Automation & AI Evaluation (Healthcare): Leading the quality engineering strategy for the Ignite Growth Platform with an accent on automation-first frameworks and AI evaluation methodologies. Focus on building evaluation harnesses for LLM-powered features, mentoring the QA team, and establishing release-readiness governance in a regulated healthcare environment.

Location: Must be based in Newark, New Jersey, United States

Compensation: $98,000–$135,000

Company

hirify.global Ignite is a growth partner for healthcare organizations, providing comprehensive solutions that optimize patient experiences and outcomes across a portfolio of leading health brands.

What you will do

• Lead an automation-first quality strategy to eliminate manual testing and standardize practices across the organization.
• Design and own evaluation frameworks for LLM-powered and agentic systems, focusing on correctness and hallucination detection.
• Apply AI to QA processes, including self-healing automation and intelligent defect triage.
• Provide direct leadership, mentorship, and structure to the existing quality assurance team.
• Partner with engineering and DevOps to embed quality gates and ensure release readiness.

Requirements

• 7+ years of experience in quality engineering or test automation, including team leadership.
• Deep, hands-on expertise in modern frameworks like Playwright, Cypress, or Selenium.
• Proven experience building automated test suites and integrating them into CI/CD pipelines.
• Experience designing evaluation approaches for AI/ML or LLM-powered systems.
• Strong understanding of test strategy, defect management, and release governance.

Nice to have

• Experience testing generative AI or agentic products.
• Background in healthcare, health IT, or other regulated delivery environments.
• Familiarity with quality management systems and traceability requirements.

Culture & Benefits

• Comprehensive health insurance including medical, dental, and vision.
• 401(k) retirement plan with employer matching.
• Generous paid time off including vacation, sick leave, and flexible holidays.
• Life and disability insurance coverage.
• Employee Assistance Program and commuter benefits.