AI Test Engineer (AI/ML)

TL;DR

AI Test Engineer (AI/ML): Designing, developing, and executing comprehensive test strategies and plans for AI/ML models and applications with an accent on data quality, model accuracy, and security compliance. Focus on implementing automated testing frameworks, identifying biases, and integrating testing into CI/CD pipelines.

Location: Irving, TX (Onsite)

Salary: $55/hr

Company

hirify.global is looking for a skilled AI Test Engineer to join a growing team focused on IAM Tools Engineering.

What you will do

• Develop and implement robust test plans and strategies tailored for AI/ML systems.
• Design and create detailed test cases for various AI testing types, including model output validation, performance, bias, fairness, robustness, and data quality.
• Identify vulnerabilities in AI systems and ensure compliance with data protection standards (e.g., GDPR, CCPA).
• Execute manual and automated test cases, analyze results, and accurately document defects and issues.
• Implement and maintain automated testing frameworks for AI/ML models and pipelines using programming languages like Python.
• Integrate testing processes into Continuous Integration/Continuous Deployment (CI/CD) pipelines.

Requirements

• 5+ years of practical Software Testing experience with web-based applications using automated test engineering tools.
• College degree in Computer Science/Engineering or equivalent work experience.
• Strong technical background with prior programming experience and a solid understanding of how to embed test automation in CI/CD pipelines.
• Strong proficiency in Python and understanding of AI/ML concepts, algorithms, and workflows (e.g., supervised/unsupervised learning, neural networks).
• Experience with data validation, cleansing, and quality assurance processes for large datasets.
• Knowledge of API testing tools (e.g., Postman) and familiarity with version control systems (e.g., Git).

Nice to have

• Experience with Agile methodologies (Ceremonies, Definition of Done, Lean Thinking).
• Experience with Selenium, Vulcan, SpecFlow, or similar testing tools.
• Knowledge of DevOps practices.
• Experience with Atlassian products (e.g., Confluence and JIRA).

Culture & Benefits

• Work in a collaborative, fast-paced environment.
• Opportunity to engage in a matrixed organization and develop partnerships across business, analyst, and development teams.
• Drive quality assurance strategy for a cutting-edge AI-enabled self-service identity solution.
• Be part of a team passionate about quality and possessing excellent problem-solving skills.
• W2 contract employment.