QA Engineer (Localization)

TL;DR

QA Engineer (Localization): Drive quality for localized product features and AI-driven content across global markets with an accent on linguistic accuracy, cultural appropriateness, and automation. Focus on designing test plans for LLM outputs, implementing AI quality frameworks, and building internal testing tools.

Hybrid in Lisbon, Portugal or Krakow, Poland: must attend local office for part of the week.

Company

Customer experience software platform powering billions of conversations for brands worldwide with over 5,000 employees globally.

What you will do

• Act as final gatekeeper for product user experience in diverse markets, ensuring native feel across locales.
• Implement and run AI quality frameworks and tools to automate localization testing.
• Design and execute end-to-end test plans for AI features, validating LLM content for accuracy and cultural fit.
• Serve as technical contact for external QA vendors, providing bug docs, test data, and feedback.
• Collaborate with engineers to develop internal testing tools and platforms.
• Generate and manage testing data for localized features throughout release cycles.

Requirements

• 1–2 years in software testing, QA, or technical localization roles.
• Hands-on experience testing AI/LLM features, evaluating outputs for accuracy, tone, and locale quality.
• Ability to identify, document, and track bugs via structured QA processes.
• Foundational knowledge of scripting (Python, JavaScript) or web technologies.
• Growth mindset for fast-paced, ambiguous environments.

Nice to have

• Software Engineering or QA Bootcamp completion.
• Experience with QE frameworks or LLM evaluation (BLEU, COMET, LLM-as-judge).
• Familiarity with prompt engineering and locale-varying LLM outputs.
• Native/professional fluency in German or Spanish.

Culture & Benefits

• Hybrid model with onsite collaboration, learning, and flexibility for remote work part-time.
• Global team across offices, kitchen tables, and coworking spaces.
• Emphasis on digital-first experiences, diversity, equity, and inclusion.
• Equal opportunity employer with accommodations for disabilities.