AI QA Engineer

Location: Hybrid work from the Selangor or Penang office, Malaysia; occasional travel for team meetings or training.

Company

hirify.global is a Nasdaq-listed provider of enterprise software support, managed services, and Agentic AI ERP solutions for Oracle, SAP, and VMware platforms.

What you will do

• Execute manual and automated tests for APIs, UI components, and AI agent workflows.
• Develop and maintain Python-based automated, integration, and regression test suites.
• Validate tool invocations, schema compliance, permission gating, fallback behavior, durable workflows, retries, and audit log completeness.
• Validate AI agent outputs against accuracy thresholds and evaluation criteria.
• Document defects, reproduce issues, diagnose root causes with developers, and verify fixes.
• Maintain test infrastructure, CI/CD pipelines, test data, containerized environments, fixtures, and mock services.

Requirements

• 3+ years of QA engineering experience with hands-on test automation.
• Python and experience with Pytest, Selenium, Playwright, or a similar framework.
• Experience testing REST APIs and web applications, including API contract testing and schema validation.
• Knowledge of Docker, SQL fundamentals, Git workflows, CI/CD pipelines, and defect tracking or test management tools.
• Familiarity with Agile development processes and enterprise or B2B platforms.
• Fluent English required in written and verbal communication.

Nice to have

• Experience testing Angular applications, performance testing, observability tools, or distributed traces.
• Familiarity with LLM-as-judge, Promptfoo, DeepEval, or similar AI output evaluation frameworks.
• Experience testing AI/ML outputs, durable execution patterns, or workflow replay.
• Bachelor’s degree in a related field, ISTQB certification, or contributions to open-source testing tools.

Culture & Benefits

• Work with enterprise software and AI-driven ERP products used by global organizations.
• Collaborative environment focused on innovation, client outcomes, professional growth, and community impact.
• Compensation, bonuses, and benefits aligned with skills and performance.
• Minimal travel, limited to occasional team meetings or training.