3 дня назад
Lead Test Framework Architect (AI)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Test Framework Architect (AI): Building AI-native test frameworks and evaluation systems for a Kubernetes-based software platform with an accent on automated quality gates, distributed-system testing, and regulated GxP environments. Focus on designing non-deterministic LLM evaluations, integrating AI-assisted testing into CI/CD, and establishing traceability and human-in-the-loop governance.
Location: Barcelona, Spain
Company
develops software platforms spanning scientific instruments, applications, and shared services across multiple product lines.
What you will do
- Lead AI-assisted software development lifecycle adoption for quality engineering, including test authoring, execution, triage, and maintenance.
- Design and build AI-native unit, contract, integration, end-to-end, and performance testing frameworks for a Kubernetes-based microservices platform.
- Develop evaluation and regression frameworks for LLM- and agent-powered features, covering hallucination and grounding scores, drift detection, observability, and non-deterministic evaluation.
- Integrate GitHub Copilot and complementary AI testing tools into CI/CD quality gates.
- Establish risk-based governance, review checkpoints, acceptance criteria, rollback triggers, audit trails, and traceability for AI-generated code and tests.
- Define test environment, test data, contract testing, quality gate, and testability-by-design standards, while measuring adoption and delivery impact through DORA and AI-specific metrics.
Requirements
- 10+ years of software engineering experience, including 3+ years in test architecture or quality engineering architecture.
- Daily hands-on experience with AI-assisted development and testing tools such as GitHub Copilot, Claude Code, Cursor, or equivalent.
- Deep Kubernetes expertise covering ephemeral namespaces, container-based test infrastructure, and environment-as-code.
- Strong experience designing multi-level automated testing frameworks for distributed systems, including unit, contract, integration, end-to-end, and performance testing.
- Experience with CI/CD architecture, quality gates, contract testing, microservices, and API-first architectures.
- Experience delivering reusable frameworks adopted across multiple product teams and leading engineering change with measurable outcomes.
Nice to have
- Experience testing AI/ML, LLM, or agent-based systems using evaluation, regression, hallucination, grounding, or drift-detection methods.
- Knowledge of 21 CFR Part 11, GxP, GAMP 5, Computer Software Assurance, and IEC 62304.
- Experience with LLM context engineering, RAG, MCP servers, OpenTelemetry GenAI conventions, infrastructure-as-code, GitOps, or platform-scale load testing.
- Background in scientific instruments, laboratory platforms, life sciences, or diagnostics software.
Culture & Benefits
- Independent role in a growth-oriented organization with collaborative colleagues.
- Commitment to work-life balance and opportunities for learning and professional growth.
- Depending on the country of employment: result bonus, stock purchase plan, life insurance, pension, healthcare, employee assistance program, holiday allowance, and company activities.
- Full-time weekly schedule, daytime shift, and approximately 25% travel.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →