Назад
Company hidden
6 дней назад

AI Quality Engineer (AI)

4 500
Формат работы
remote (Europe)/hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Lithuania
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/

TL;DR

AI Quality Engineer (AI/QA): Defining success criteria and testing strategies for AI-powered products with an accent on evaluation frameworks for AI behavior and hallucination rates. Focus on building validation pipelines, identifying AI failure modes, and establishing quality standards for LLM-based systems.

Location: Remote (Global) or Hybrid (Kaunas/Vilnius, Lithuania)

Salary: Gross starting from 4,500 EUR/month

Company

hirify.global provides AI-powered tools to help individuals and small businesses succeed online faster and easier.

What you will do

  • Define success criteria for AI-driven features and clarify quality standards where industry playbooks do not yet exist.
  • Design and execute testing strategies, including exploratory and adversarial testing to uncover failure modes.
  • Develop evaluation frameworks to measure AI accuracy, consistency, hallucination rates, and stability.
  • Build and maintain testing datasets, validation pipelines, and experimentation frameworks.
  • Identify patterns in AI behavior to determine strengths, weaknesses, and risk areas.
  • Act as the voice of quality strategy, bridging the gap between development and quality assurance.

Requirements

  • 4+ years of experience in software quality engineering.
  • Proficiency in web testing and automation using Playwright, Cypress, Selenium, or similar tools.
  • Strong programming skills, preferably in TypeScript.
  • Experience with API manual testing and automation using Postman, Swagger, or similar.
  • Knowledge of databases, specifically MySQL.
  • English: Strong communication skills required.

Nice to have

  • Hands-on experience testing LLM-based or AI-driven systems, including prompt engineering.
  • Experience with evaluation datasets or benchmarking methods.
  • Deep understanding of AI failure modes such as hallucinations, bias, and drift.
  • Experience working in fast-paced, experimental environments with evolving requirements.

Culture & Benefits

  • Limitless learning opportunities via Reforge, Coach Hub, global conferences, and mentoring.
  • Flexible work arrangement: modern offices in Kaunas and Vilnius, home, or anywhere in the world.
  • Health insurance from Day 1, gym memberships, and Headspace subscriptions.
  • Company events including Summerfest, Winterfest, and team-building workations.
  • Access to Žalgiris Arena VIP Lounge and milestone gifts for major life events.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →