Lead AI SRE and QA Engineer

Location: On-site in Kraków, Poland

Company

A global science and technology company operating across life sciences, diagnostics, and biotechnology, with an enterprise AI engineering capability focused on scalable AI solutions.

What you will do

• Define testing frameworks, reliability standards, and quality practices for reusable enterprise AI solutions.
• Implement monitoring and observability standards and improve application resilience.
• Lead AI quality initiatives, operational KPIs, quality metrics, and executive reporting on system health and reliability.
• Develop AI-specific validation frameworks covering model accuracy, hallucination rates, prompt effectiveness, response quality, safety, bias, interpretability, and responsible AI compliance.
• Lead production readiness reviews, operational risk assessments, incident management, and root cause analysis.
• Partner with AI, software, platform, data, IT, security, product, and business stakeholders.

Requirements

• Bachelor’s or master’s degree in computer science, software engineering, information technology, engineering, or a related technical discipline.
• 10+ years of experience in SRE, quality engineering, test automation, software development, cloud platforms, and monitoring tools.
• Hands-on experience with cloud-native applications on Azure, AWS, or Google Cloud.
• Experience with automated testing frameworks, CI/CD pipelines, quality engineering, and release management.
• Experience designing and implementing enterprise-scale monitoring, observability, and production support capabilities.
• Experience developing and applying data science, machine learning, and AI solutions.

Nice to have

• Experience with generative AI, large language model applications, and AI model testing, evaluation, or benchmarking.
• Experience in reliability engineering, performance engineering, and load testing for distributed systems.
• Experience in life sciences, diagnostics, healthcare, advanced manufacturing, or another regulated industry.

Culture & Benefits

• Work within a culture of continuous improvement and belonging.
• Collaborate across product, architecture, AI science, engineering, operations, and business functions.
• Contribute to AI solutions designed for measurable business impact across operating companies.
• Build expertise and career opportunities within a global science and technology organization.