6 дней назад
AI QA Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
AI QA Engineer (AI/data platform): Building automated quality solutions for an intelligent data-management platform, including evaluation datasets, regression suites, and test automation across unit, integration, and end-to-end layers with an accent on non-deterministic AI outputs, accuracy, latency, cost, and functional correctness. Focus on testing AI systems for drift, hallucinations, guardrails, reliability, and scalability while supporting cloud-based processing services.
Location: Prague, Czech Republic; primarily in-office work is required.
Company
is developing an intelligent data-management platform for discovering, classifying, contextualizing, enriching, and securing data across SaaS, on-premises, cloud, and hybrid environments.
What you will do
- Design and execute quality strategies for AI-driven platform features.
- Build evaluation datasets, regression suites, and quality metrics for non-deterministic outputs.
- Validate AI feature accuracy, latency, cost, and functional correctness.
- Create and maintain automation across unit, integration, and end-to-end testing layers.
- Collaborate with engineering teams and stakeholders from initial design through production.
- Contribute to code reviews, documentation, continuous integration, continuous deployment, and quality improvement practices.
Requirements
- Experience designing, implementing, testing, and operating software applications or platform components.
- Proficiency in Python, Java, Go, or another modern programming language.
- Experience with cloud platforms such as AWS, Azure, or Google Cloud, including Kubernetes.
- Experience with SQL and NoSQL databases, data structures, algorithms, and modern software engineering practices.
- Familiarity with AI-assisted QA automation and cloud networking concepts.
- Strong collaboration, communication, and problem-solving skills.
Nice to have
- Exposure to AI or ML feature testing, including evaluation harnesses, prompt and model regression testing, or output-quality measurement.
- Interest in addressing AI quality challenges such as non-determinism, drift, hallucinations, and guardrail verification.
Culture & Benefits
- Innovation-focused environment that encourages critical thinking and experimentation.
- Support for professional growth and contribution to meaningful platform transformation.
- Collaborative team culture focused on shared success and continuous improvement.
- Flexible time off, wellness resources, and company-sponsored team events.
- Inclusive workplace with employee resource groups and accommodations available throughout the hiring process.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →