AI Tester (AI)

TL;DR

AI Tester (AI/QA): Driving end-to-end quality assurance and advanced validation frameworks for complex web interfaces and AI-driven systems with an accent on LLM output validation and distributed backend architectures. Focus on building scalable automation frameworks, auditing Kafka-based streaming pipelines, and evaluating Generative AI models for accuracy and safety.

Location: Hybrid in Abu Dhabi or Dubai, UAE

Company

hirify.global is a specialist AI and data consultancy focused on implementing intelligent enterprise systems, particularly for the financial services and banking sectors.

What you will do

• Build and maintain scalable E2E automation frameworks using Playwright.
• Validate distributed microservices via RESTful and gRPC API testing suites.
• Audit asynchronous, event-driven data architectures and Kafka streaming pipelines.
• Develop methodologies to evaluate LLM outputs for hallucination, bias, and semantic accuracy.
• Manage and version prompt validation datasets for AI performance benchmarking.
• Integrate automated testing gates into CI/CD pipelines via GitHub Actions or Azure DevOps.

Requirements

• Minimum of 6 years of experience in software quality engineering or SDET roles.
• Advanced proficiency in Playwright and testing RESTful/gRPC APIs.
• Practical knowledge of AI quality tools such as Ragas, LangSmith, or TruLens.
• Advanced coding proficiency in TypeScript, JavaScript, or Python.
• Competence in interacting with event streaming platforms like Kafka or Azure Event Hubs.
• Experience with Docker and Kubernetes orchestration.

Nice to have

• Familiarity with banking data privacy, regulatory security compliance, and risk environments.
• Experience with performance testing utilities such as k6, JMeter, or Locust.
• Basic understanding of the Machine Learning Lifecycle and dataset versioning (e.g., DVC).

Culture & Benefits

• Competitive salary and comprehensive personal health insurance.
• Visa sponsorship for the successful candidate.
• Professional development, certification support, and subscription reimbursements.
• Opportunity to work on cutting-edge AI projects in a rapidly growing company.
• Monthly Employee Incentive program and career advancement opportunities.