TL;DR

Lead QA Engineer (AI/ML): Developing and implementing QA strategies tailored for AI/ML solutions, including models, APIs, and pipelines, with an accent on model validation, performance metrics, and compliance. Focus on building automated AI testing frameworks, identifying anomalies, and ensuring timely resolutions for high-quality AI solutions.

Location: Alpharetta, Georgia, USA. Candidates must be legally authorized to work for any employer in the United States without the need for current or future immigration sponsorship.

Company

%hirify_global% is a dynamic team passionate about innovation, learning, and applying cutting-edge technologies to deliver high-quality AI solutions within its Enterprise AI/ML Organization.

What you will do

Develop and implement QA strategies for AI/ML solutions, including models, APIs, pipelines, and agent-based architectures.
Create and maintain automated and manual test cases for model validation (accuracy, bias, robustness, explainability, drift).
Collaborate with AI engineers, data scientists, and product teams to define success criteria and performance metrics.
Validate model outputs and system behaviors against business and ethical guidelines.
Perform regression, integration, stress, and adversarial testing of AI models and systems.
Support monitoring production AI systems to detect model performance degradation (concept drift, data drift, hallucinations).

Requirements

Bachelor’s degree in Computer Science, Engineering, or a related field.
Minimum 6 years of experience in quality assurance, specifically testing AI/ML applications.
Hands-on skills with Python and relevant AI/QA libraries (Pytest, Unittest, Great Expectations, MLflow, Deepchecks, etc.).
Familiarity with machine learning frameworks (TensorFlow, PyTorch, or scikit-learn).
Experience with test automation tools and frameworks, CI/CD tools (Jenkins, GitLab CI), containerization (Docker, Kubernetes), and version control (Git).
Strong understanding of software testing methodologies and best practices.

Culture & Benefits

Join a dynamic team passionate about innovation and learning.
Opportunity to apply cutting-edge technologies in AI solutions.
Focus on delivering high-quality, reliable AI systems.