AI Quality Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
AI Quality Engineer (AI/QA): Defining success criteria and testing strategies for AI-powered products with an accent on evaluation frameworks for AI behavior and hallucination rates. Focus on building validation pipelines, identifying AI failure modes, and establishing quality standards for LLM-based systems.
Location: Remote (Global) or Hybrid (Kaunas/Vilnius, Lithuania)
Salary: Gross starting from 4,500 EUR/month
Company
provides AI-powered tools to help individuals and small businesses succeed online faster and easier.
What you will do
- Define success criteria for AI-driven features and clarify quality standards where industry playbooks do not yet exist.
- Design and execute testing strategies, including exploratory and adversarial testing to uncover failure modes.
- Develop evaluation frameworks to measure AI accuracy, consistency, hallucination rates, and stability.
- Build and maintain testing datasets, validation pipelines, and experimentation frameworks.
- Identify patterns in AI behavior to determine strengths, weaknesses, and risk areas.
- Act as the voice of quality strategy, bridging the gap between development and quality assurance.
Requirements
- 4+ years of experience in software quality engineering.
- Proficiency in web testing and automation using Playwright, Cypress, Selenium, or similar tools.
- Strong programming skills, preferably in TypeScript.
- Experience with API manual testing and automation using Postman, Swagger, or similar.
- Knowledge of databases, specifically MySQL.
- English: Strong communication skills required.
Nice to have
- Hands-on experience testing LLM-based or AI-driven systems, including prompt engineering.
- Experience with evaluation datasets or benchmarking methods.
- Deep understanding of AI failure modes such as hallucinations, bias, and drift.
- Experience working in fast-paced, experimental environments with evolving requirements.
Culture & Benefits
- Limitless learning opportunities via Reforge, Coach Hub, global conferences, and mentoring.
- Flexible work arrangement: modern offices in Kaunas and Vilnius, home, or anywhere in the world.
- Health insurance from Day 1, gym memberships, and Headspace subscriptions.
- Company events including Summerfest, Winterfest, and team-building workations.
- Access to Žalgiris Arena VIP Lounge and milestone gifts for major life events.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →