Lead Software Engineer in Test (Agentic AI)

TL;DR

Lead Software Engineer in Test (Agentic AI): Leading quality engineering strategy for next-generation AI-powered applications and distributed systems with an accent on LLM workflows and RAG pipelines. Focus on validating complex AI agent behaviors, designing scalable automation frameworks, and ensuring system reliability under failure conditions.

Location: Remote (Must be based in the US)

Company

hirify.global is a leader in specialty healthcare technology solutions.

What you will do

• Design and maintain scalable automation frameworks across UI, API, and backend for AI-driven applications.
• Lead quality engineering for Agentic AI systems, including LLM workflows, RAG pipelines, and autonomous agents.
• Validate complex AI behaviors such as multi-agent coordination, prompt chaining, and memory retention.
• Develop and execute E2E, integration, and performance testing strategies in cloud-native environments.
• Integrate automated tests into CI/CD pipelines and manage robust test environments.
• Mentor QA engineers and establish enterprise-wide quality standards and reporting practices.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical field.
• 8+ years of experience in SDET/SET roles, with 5+ years of hands-on experience in JavaScript/TypeScript or Java.
• 2+ years of experience testing AI-powered applications, LLM systems, or Agentic AI platforms.
• Expertise in automation tools such as Playwright, Cypress, Postman, or K6.
• Experience with cloud-native and containerized environments (Azure, AWS, GCP, Docker, Kubernetes).
• Must be based in the United States.

Nice to have

• Experience with Azure DevOps or GitHub Actions.
• Knowledge of healthcare systems and HIPAA compliance.
• Experience with AI observability tools, telemetry platforms, and vector databases.
• Prior experience leading QA teams and implementing enterprise quality metrics.

Culture & Benefits

• Competitive pay and generous annual bonus opportunity.
• Comprehensive insurance (Medical, Dental, Vision) and HSA with employer match.
• 401(k) with employer match.
• Flexible Time Off and 11 paid holidays.
• 100% company-paid parental leave after 6 months.
• Wellness program and corporate discounts on retail, travel, and entertainment.