Test Automation Engineer (AI)

Location: Multiple locations; hybrid

Company

hirify.global provides technology advisory, enterprise solutions, managed services, product development, and software development through a global community of specialists.

What you will do

• Define test strategies and test cases covering functional, regression, integration, and exception scenarios.
• Test automation workflows, low-code applications, and AI agent outputs against acceptance criteria.
• Validate AI agents for accuracy, consistency, safe failure behavior, and edge-case handling.
• Log, triage, and track defects with AI Engineers and the Solution Architect through resolution.
• Own formal QA sign-off before release and support post-go-live monitoring where required.
• Contribute quality and defect data to the E2E Summary Dashboard for cross-client reporting.

Requirements

• Senior-level QA or test engineering experience in automation, low-code, or AI delivery environments.
• Hands-on experience with Python.
• Familiarity with Playwright and automated testing with TypeScript.
• Practical experience testing AI or agentic systems, including non-deterministic outputs and statistically robust validation.
• Knowledge of test management, defect tracking, and Jira integration.
• Upper-intermediate English required. Understanding of responsible AI governance, including bias, safety, and escalation behavior.

Nice to have

• Knowledge of KQL for analyzing outputs and logs in Azure Log Analytics.
• Experience testing Microsoft Power Platform and Power Automate solutions.
• Knowledge of Microsoft Copilot Studio and AI agents in the Microsoft ecosystem.

Culture & Benefits

• Hybrid work across multiple locations.
• Equal opportunities in recruitment, career development, and leadership.
• Inclusive environment shaped by people from diverse backgrounds and experiences.

Hiring process

• Application review followed by a Talent Acquisition interview.
• Technical interview focused on expertise, problem-solving, and approach.
• Customer interview may be included, followed by an offer and onboarding.