AI Test Automation Engineer (AI)

Location: Hybrid in Gibraltar or the Isle of Man

Company

hirify.global is a product development company headquartered in Gibraltar, building technology and entertainment solutions for social gaming.

What you will do

• Build and maintain API, integration, and end-to-end regression tests for critical workflows.
• Evaluate AI agents for task completion, response quality, tool use, and permissions.
• Measure the impact of model, prompt, and context changes on agent results.
• Integrate quality checks into CI/CD pipelines and convert production defects into regression cases.
• Use AI agents to explore workflows, generate tests, and reproduce bugs, then validate the findings.
• Share effective tools and methods with the AI team and central QA department.

Requirements

• Strong test automation and programming skills in TypeScript or Python.
• Hands-on experience with web applications, APIs, Git, and CI/CD.
• Structured approach to evaluating AI output against clear, measurable criteria.
• Ability to reproduce, isolate, and identify the root causes of bugs quickly.
• Direct communication skills, including documenting decisions and sharing effective practices.

Nice to have

• Experience with agentic browser testing.
• Experience with LLM evaluation frameworks, Supabase, Vercel, or GCP.

Culture & Benefits

• Work in a high-performance, fast-scaling product environment focused on AI agent evaluation and gaming innovation.
• Take ownership of work with close connection to its impact.
• Prioritize achievable deadlines, shipping, learning, and continuous improvement.
• Use open Slack channels, Monday.com for outcomes, and Google Meet with cameras on.
• Work in an open, concise, inclusive environment that values skills, drive, ideas, and diverse perspectives.