Senior QA Engineer (AI)

Location: Remote from Argentina, Brazil, Poland, or Ukraine; working hours aligned with LATAM.

Company

hirify.global is an AI-native consulting and technology services firm delivering cloud, data, software engineering, and artificial intelligence solutions for enterprise clients.

What you will do

• Plan, design, and execute tests for AI-powered and traditional web, mobile, and API features.
• Choose eval-based or deterministic testing methods according to the target behavior.
• Convert business requirements, user flows, and procedures into test plans, cases, and scripts.
• Perform manual feature testing, verify bug fixes, and conduct integration, regression, performance/load, and UAT testing.
• Document defects, AI hallucinations, unexpected model responses, and performance regressions.
• Help establish QA practices for emerging AI technologies and share testing best practices across the team.

Requirements

• 5–7 years of software testing experience across web, mobile, and API.
• Production experience with Playwright is required.
• Hands-on experience testing AI/LLM-integrated products for accuracy, relevance, robustness, adversarial prompts, edge cases, and safety.
• Strong understanding of deterministic versus probabilistic AI testing, including human-in-the-loop evaluation, scoring metrics, benchmark datasets, and semantic evaluation.
• Knowledge of web and mobile development lifecycles, including iOS and Android, plus browser DevTools, log monitoring, Jira, Confluence, and test management systems.
• Experience with integration, regression, performance/load, UAT, and manual feature testing.

Nice to have

• Experience with Charles Proxy or Fiddler.
• Knowledge of Xcode and ADB logs.
• Experience in financial services or fintech.
• Bachelor’s degree in Computer Science or an equivalent qualification.

Culture & Benefits

• Work on real-world AI-driven projects across multiple industries.
• Collaborate with a global team across continents and cultures.
• Inclusive environment focused on continuous learning, innovation, and ethical AI standards.