Lead Software Engineer in Test – Agentic AI (Remote - US)

Location: Remote within the United States

Company

hirify.global provides specialty healthcare technology solutions for regulated enterprise environments.

What you will do

• Design, develop, and maintain scalable automation frameworks and regression suites across UI, API, backend, and AI-driven applications.
• Lead quality engineering for LLM workflows, RAG pipelines, autonomous agents, and distributed orchestration platforms.
• Validate multi-agent coordination, tool calling, prompt chaining, memory retention, conversational workflows, and fallback mechanisms.
• Develop functional, integration, regression, end-to-end, and performance testing strategies for cloud-native and distributed environments.
• Integrate automated testing into the software development lifecycle, CI/CD pipelines, and cloud execution platforms.
• Mentor QA engineers and establish scalable automation, reporting, quality, and continuous improvement practices.

Requirements

• Bachelor’s degree in Computer Science, MIS, Engineering, or a related technical field.
• 8+ years of experience in software development or SDET/SET roles, including 5+ years developing automation frameworks with JavaScript, TypeScript, or Java.
• Strong experience with Playwright, Cypress, Postman, K6, or equivalent automation frameworks.
• At least 2 years of experience testing AI-powered applications, LLM systems, agentic AI platforms, orchestration frameworks, or autonomous workflows.
• Experience with API, backend integration, UI, end-to-end, asynchronous, event-driven, and distributed systems testing.
• Experience with cloud-native and containerized environments including Azure, AWS, GCP, Docker, and Kubernetes, plus CI/CD integration.

Nice to have

• Experience with LangGraph, CrewAI, AutoGen, Semantic Kernel, AI observability, telemetry, prompt evaluation, RAG pipelines, or vector databases.
• Experience with Azure DevOps, GitHub Actions, event-driven architectures, messaging systems, distributed data platforms, or SQL Server.
• Knowledge of healthcare systems, HIPAA compliance, and regulated enterprise environments.
• Prior experience leading QA teams, mentoring engineers, and implementing quality metrics and reporting practices.

Culture & Benefits

• Remote work with flexible time off and 11 paid holidays.
• Generous annual bonus opportunity.
• 401(k) with employer match and health, dental, and vision insurance.
• Health Savings Account and Flexible Spending Account options.
• Company-paid parental leave after six months, life insurance, and short- and long-term disability insurance.
• Professional development through LinkedIn Learning, employee assistance counseling, peer recognition, and corporate discounts.