13 дней назад
GenAI Quality Engineer
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
GenAI Quality Engineer (AI/LLM): Testing AI-first applications and validating LLM-generated outputs with an accent on probabilistic system behavior, reliability, and automated quality solutions. Focus on designing test strategies, evaluating response accuracy and safety, analyzing defects, and driving root-cause resolution across engineering, product, and AI teams.
Location: Sofia, Bulgaria; hybrid work model with 3 days per week in the Sofia office
Company
Tieto Tech Consulting provides design-led, data-centric, and AI-powered digital engineering and consulting services for enterprises worldwide, with a Bulgarian team of more than 500 professionals.
What you will do
- Validate LLM-based applications and AI-generated outputs.
- Evaluate the quality, reliability, and behavior of probabilistic AI systems.
- Create test cases and test plans from evolving product requirements.
- Identify gaps, inconsistencies, defects, and product risks.
- Collaborate with product managers, engineers, and AI specialists throughout the development lifecycle.
- Perform root cause analysis and drive issue resolution.
Requirements
- Experience testing AI-powered applications, GenAI solutions, chatbots, copilots, or similar products.
- Understanding of AI/ML concepts and Large Language Models.
- Experience creating test plans, test cases, and quality metrics.
- Strong analytical and problem-solving skills.
- Excellent spoken and written English.
- Availability to work in a hybrid model with 3 days per week in the Sofia office.
Nice to have
- Experience with AI testing tools and frameworks.
- Experience evaluating LLM responses for accuracy, relevance, safety, and consistency.
- Familiarity with prompt engineering and AI quality assessment techniques.
- Knowledge of Python or another programming language used in automation.
- Experience with Agile development environments or cloud platforms such as Azure, AWS, or GCP.
Culture & Benefits
- Work within a multinational technology consulting organization with Nordic quality standards and global-scale operations.
- Collaborate with engineering, product, and AI specialists on modern AI-first applications.
- Inclusive workplace focused on diversity, equity, openness, trust, and innovation.
Hiring process
- Application review followed by interviews.
- Assessments and tests may be included.
- Background verification precedes the offer and welcome stages.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Музыка
Осень
Поддержка