AI QA Automation Engineer

Location: Remote from Poland, Bulgaria, Georgia, Isle of Man, or Romania

Company

hirify.global is a product development company building technology and entertainment solutions for social gaming.

What you will do

• Build and maintain API, integration, end-to-end, and regression tests for critical workflows.
• Evaluate AI agents for task completion, response quality, tool use, and permissions.
• Measure the impact of model, prompt, and context changes on results.
• Build quality checks into CI/CD pipelines and convert production defects into regression cases.
• Use AI agents to explore workflows, generate tests, and reproduce bugs, then validate the findings.
• Share effective tools and methods with the AI team and central QA department.

Requirements

• Strong test automation and programming skills in TypeScript or Python.
• Hands-on experience with web applications, APIs, Git, and CI/CD.
• Structured approach to evaluating AI output against clear, measurable criteria.
• Ability to reproduce, isolate, and identify root causes of bugs quickly.
• Direct communication skills and a habit of documenting decisions and sharing effective practices.

Nice to have

• Experience with agentic browser testing, LLM evaluation frameworks, Supabase, Vercel, or GCP.

Culture & Benefits

• Remote full-time role with ownership and close connection to product impact.
• Opportunity to help define emerging practices for AI agent evaluation.
• Fast-paced environment focused on achievable deadlines, shipping, learning, and continuous improvement.
• Open communication through Slack, Monday.com, and Google Meet.
• Inclusive hiring based on skills, drive, and ideas, with diverse career backgrounds welcomed.