Senior Test Manager & Quality Engineer (AI/ML)

TL;DR

Senior Test Manager & Quality Engineer (AI/ML): Testing AI and ML solutions throughout their lifecycle with an accent on automation frameworks and LLM evaluation. Focus on designing scalable testing patterns for model APIs, orchestrating CI/CD pipelines, and ensuring quality for RAG and agentic workflows.

Location: Zurich, Switzerland

Company

A leading global private bank specializing in wealth management.

What you will do

• Define and evolve the technical testing approach and framework architecture for the ML & AI ART.
• Design reusable, scalable testing patterns including page objects, API clients, and test data builders.
• Automate test cases using Python-based frameworks (Playwright, pytest, Behave) and integrate them into GitLab CI/CD pipelines.
• Implement AI/ML-specific test cases and evaluation pipelines for LLM outputs, RAG, and agentic workflows.
• Collaborate with ML Engineer teams and Product Owners within a SAFe (Agile Release Train) environment.
• Triage execution results in Jira and manage the use of synthetic or anonymized test data.

Requirements

• 5–7 years of experience in Quality Assurance and Testing for data and ML platforms.
• Substantial hands-on Python experience, including framework design and execution at scale.
• Proficiency with Git, Docker, and a basic understanding of Kubernetes.
• Understanding of API design, microservices, and event-driven architectures.
• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• English: Fluency required.

Nice to have

• Experience working in regulated environments such as financial services, healthcare, or pharma.
• ISTQB Foundation certification.
• SAFe (SP, SSM) or DevOps certifications.
• Working knowledge of German.

Culture & Benefits

• Entrepreneurial and empowering work environment that values individual qualities.
• Opportunity to shape the future of wealth management through AI and ML integration.
• Collaborative team culture within a modern Agile Release Train (ART).
• Focus on professional growth in the cutting-edge domain of AI quality assurance.