QA Engineer (AI)

TL;DR

QA Engineer (Python/Playwright): Building and maintaining scalable testing infrastructure for an AI safety platform with an accent on end-to-end automation and CI/CD integration. Focus on improving test reliability, owning coverage for new features, and establishing engineering quality standards for LLM-powered systems.

Location: Hybrid in Paris, France (Relocation package available)

Salary: $50K – $80K + Equity

Company

AI Safety company building the safety, reliability, and optimization layer for AI systems using natural-language policies.

What you will do

• Design, build, and maintain end-to-end test automation frameworks for web platforms and APIs.
• Own test coverage for new features and integrate automated suites into CI/CD pipelines.
• Create clear, reproducible bug reports and collaborate with engineers for resolution.
• Develop exploratory and regression test plans for each release cycle.
• Optimize test reliability and speed.
• Promote a quality mindset by reviewing testability in design and flagging risks early.

Requirements

• 2+ years of QA automation experience with a track record of building frameworks from scratch.
• Proficiency with Playwright for scalable end-to-end UI testing.
• Strong Python skills (pytest, fixtures, parametrize).
• Experience integrating tests into CI/CD pipelines (GitHub Actions, GitLab CI, etc.).
• Fluent English proficiency.
• Experience using AI coding agents and LLM-powered developer tools to improve productivity.

Nice to have

• Experience testing AI/LLM products (non-deterministic outputs, confidence scoring).
• Familiarity with performance or load testing tools like k6 or Locust.
• Experience with Postman, Insomnia, Yaak, or API contract testing.
• Background in security-aware QA or SOC 2 environments.

Culture & Benefits

• Paid time off according to local regulations.
• Relocation package for moving to Paris.
• Premium medical insurance in France.
• Provision of all necessary hardware, tools, and covered AI agent/IDE subscriptions.
• Bi-annual team off-sites (e.g., Alps, Saint-Tropez).

Hiring process

• Introductory HR call (20 min).
• Take-home technical test task.
• Technical interview with a QA Engineer (1h).
• Final interview with the CEO and Head of Engineering (45 min).