Senior QA Automation Engineer (AI)

TL;DR

Senior QA Automation Engineer (Python/TypeScript): Designing and owning the automated testing framework and CI pipelines for a Legal AI platform with an accent on AI-assisted tooling and non-deterministic feature testing. Focus on building evaluation harnesses for LLMs/RAG, optimizing developer experience, and ensuring system reliability for complex asynchronous flows.

Location: Hybrid (Berlin, Germany). Must be based in Germany and spend at least 8 days per month in the office.

Company

hirify.global is building Libra, an AI-powered operating system for modern legal work that transforms how lawyers research and draft documents.

What you will do

• Own, evolve, and continuously improve the automated test framework used by the entire engineering team.
• Design and implement E2E and integration tests for complex, cross-cutting flows.
• Coach and pair with engineers on test design and review their test plans to raise quality standards.
• Build and optimize CI pipelines with parallelism, fast feedback, and automated quality gates.
• Integrate AI-powered testing tools for test generation, regression detection, and flakiness triage.
• Establish testing patterns for non-deterministic features including LLM responses, RAG retrieval, and async pipelines.

Requirements

• Minimum 5 years of experience in software engineering with a strong focus on test automation and CI infrastructure.
• Strong proficiency in Python (pytest, async) and TypeScript (Playwright or equivalent E2E framework).
• Deep experience with modern CI/CD platforms, specifically GitHub Actions.
• Hands-on experience using AI coding agents like Cursor or Claude Code.
• Proven experience testing distributed, asynchronous, and eventually-consistent systems.
• English: Excellent communication skills (C1).

Nice to have

• Experience building test infrastructure or evaluation harnesses for LLM-powered products.
• Proficiency in German.

Culture & Benefits

• Permanent employment contract from day one.
• Hybrid work model: remote up to 3 days per week with flexible working hours.
• Flexibility to work from anywhere within the EU for up to 20 days per year.
• 26 vacation days plus an additional Volunteer Day for community work.
• Development support via LinkedIn E-learning, goFluent language training, and other growth opportunities.

Hiring process

• Interviews are conducted without the assistance of AI tools or external prompts to ensure authenticity.
• The process includes in-person interviews at the hirify.global office.