Senior Data Engineer (AI)

TL;DR

Senior Data Engineer (AI): Building and maintaining scalable data pipelines and services for core search and AI-driven research platforms with an accent on batch/ELT workflows and distributed systems. Focus on designing robust data architectures, optimizing performance using Spark and Airflow, and collaborating with data science teams to deliver high-quality research insights.

Location: London

Company

A global leader in information and analytics, helping researchers and healthcare professionals advance science and improve health outcomes through quality data and innovative technology.

What you will do

• Design, build, and maintain scalable data pipelines and services.
• Develop batch and ELT/ETL workflows for processing large datasets.
• Collaborate with product, platform, and data science partners to deliver meaningful outcomes.
• Apply software engineering best practices including testing, documentation, and CI/CD.
• Contribute to cloud-based systems on AWS with a focus on reliability and monitoring.
• Support team growth through code reviews and knowledge sharing.

Requirements

• Experience working as a data or software engineer on production systems.
• Strong proficiency in Python and experience with at least one backend language such as Java.
• Solid understanding of data engineering concepts including data lakes, batch processing, and distributed systems.
• Proven experience building or operating data pipelines using Spark and Airflow.
• Familiarity with cloud platforms, preferably AWS, and production monitoring.
• Clear communication skills and a collaborative approach to problem-solving.

Culture & Benefits

• Flexible working hours to support work-life balance.
• Comprehensive pension plan and various employee discounts.
• Generous vacation entitlement with options for sabbatical leave.
• Support for family care including maternity, paternity, and adoption leave.
• Personal choice budget and internal community networks.
• Global Employee Assistance Program.