Senior QA Test Engineer (AI)

TL;DR

Senior QA Test Engineer (AI): Design and implement comprehensive test automation frameworks and strategies for web applications, APIs, data pipelines, and AI/LLM features with an accent on scalability, security, compliance, and CI/CD integration. Focus on building automated test suites, performance and load testing, validating AI accuracy with ground truth datasets, and driving continuous improvement in test coverage.

Location: Virtual

Salary: 120,000–130,000 USD

What you will do

• Create testing and automation plans, estimates, and project plans for software QA.
• Work with product owners to plan and create test cases and scenarios.
• Design and implement test automation frameworks for web apps, APIs, microservices, performance, load, security, and PHI compliance.
• Build and maintain automated test suites using Playwright, Selenium, Pytest; integrate into CI/CD pipelines with Azure DevOps.
• Design and execute tests for AI/LLM features, capture metrics, build ground truth datasets for AI accuracy.
• Guide and mentor junior QA engineers, conduct code reviews, establish testing standards, drive automation coverage and improvements.

Requirements

• B.S. in Computer Science, Software Engineering, or equivalent education and experience.
• 10+ years experience in software testing and QA.
• Competency in Scrum/agile, Selenium, C#, Azure, API testing, performance testing.
• Proven analytical skills, effective documentation, strong communication and organizational skills.
• Ability to work independently and collaboratively in fast-paced environment.
• Some experience with AI testing and/or using AI for automation.

Culture & Benefits

• Promote and live by hirify.global’s Core Values.
• 10% travel.
• Salary pay type.