Lead QA Engineer (AI/ML)

TL;DR

Lead QA Engineer (AI/ML): Developing and implementing QA strategies tailored for AI/ML solutions, including models, APIs, and pipelines, with an accent on model validation, performance metrics, and compliance. Focus on building automated AI testing frameworks, identifying anomalies, and ensuring timely resolutions for high-quality AI solutions.

Location: Alpharetta, Georgia, USA. Candidates must be legally authorized to work for any employer in the United States without the need for current or future immigration sponsorship.

Company

hirify.global is a dynamic team passionate about innovation, learning, and applying cutting-edge technologies to deliver high-quality AI solutions within its Enterprise AI/ML Organization.

What you will do

• Develop and implement QA strategies for AI/ML solutions, including models, APIs, pipelines, and agent-based architectures.
• Create and maintain automated and manual test cases for model validation (accuracy, bias, robustness, explainability, drift).
• Collaborate with AI engineers, data scientists, and product teams to define success criteria and performance metrics.
• Validate model outputs and system behaviors against business and ethical guidelines.
• Perform regression, integration, stress, and adversarial testing of AI models and systems.
• Support monitoring production AI systems to detect model performance degradation (concept drift, data drift, hallucinations).

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Minimum 6 years of experience in quality assurance, specifically testing AI/ML applications.
• Hands-on skills with Python and relevant AI/QA libraries (Pytest, Unittest, Great Expectations, MLflow, Deepchecks, etc.).
• Familiarity with machine learning frameworks (TensorFlow, PyTorch, or scikit-learn).
• Experience with test automation tools and frameworks, CI/CD tools (Jenkins, GitLab CI), containerization (Docker, Kubernetes), and version control (Git).
• Strong understanding of software testing methodologies and best practices.

Culture & Benefits

• Join a dynamic team passionate about innovation and learning.
• Opportunity to apply cutting-edge technologies in AI solutions.
• Focus on delivering high-quality, reliable AI systems.