Senior Data Engineer

TL;DR

Senior Data Engineer (Data Platform): Building and maintaining scalable data pipelines and services for AI-driven research systems with an accent on batch processing, ELT/ETL workflows, and cloud infrastructure. Focus on designing reliable data architectures, optimizing performance using Spark and Airflow, and collaborating with cross-functional teams to deliver high-impact scientific insights.

Location: London

Company

hirify.global is a global leader in information and analytics, combining quality information and vast datasets to support science, research, and healthcare.

What you will do

• Design, build, and maintain scalable data pipelines and services.
• Develop batch and ELT/ETL workflows for ingesting and processing large datasets.
• Contribute to cloud-based systems on AWS, focusing on reliability and automation.
• Collaborate with product, platform, and data science partners to deliver meaningful outcomes.
• Support team learning through code reviews and knowledge sharing.
• Apply software engineering best practices including testing, documentation, and CI/CD.

Requirements

• Experience working as a data or software engineer on production systems.
• Strong skills in Python and experience with at least one backend language such as Java.
• Understanding of data engineering concepts including data lakes, batch processing, and distributed systems.
• Experience building or operating data pipelines using tools like Spark and Airflow.
• Familiarity with cloud platforms, preferably AWS, and production monitoring.
• Clear communication skills and a collaborative approach to problem-solving.

Culture & Benefits

• Comprehensive pension plan.
• Generous vacation entitlement with sabbatical leave options.
• Flexible working hours to support work-life balance.
• Maternity, paternity, adoption, and family care leave.
• Personal choice budget and various employee discounts.
• Access to internal communities and networks.