Senior Data Engineer (AI, Search)

TL;DR

Senior Data Engineer (AI, Search): Designing, building, and running reliable data pipelines and services that support large-scale search and analytics use cases, including AI-driven research solutions. Focus on developing batch and ELT/ETL data workflows for ingesting and processing large datasets, applying good software engineering practices, and contributing to cloud-based systems.

Location: Must be based in London, with flexible working hours and home, office, or commuting allowance options.

Company

hirify.global is a global leader in information and analytics, helping researchers and healthcare professionals advance science and improve health outcomes for the benefit of society.

What you will do

• Design, build, and maintain scalable data pipelines and services.
• Develop batch and ELT/ETL data workflows for ingesting and processing large datasets.
• Work with technologies such as Python, Java, Spark, SQL, and Airflow.
• Apply good software engineering practices, including testing, documentation, and CI/CD.
• Contribute to cloud-based systems (AWS), focusing on reliability, monitoring, and automation.
• Collaborate with product, platform, and data science partners to deliver meaningful outcomes.

Requirements

• Experience working as a data or software engineer on production systems.
• Strong skills in Python and experience with at least one backend language (such as Java).
• Understanding of data engineering concepts such as data lakes, batch processing, and distributed systems.
• Experience building or operating data pipelines using tools like Spark and Airflow.
• Familiarity with cloud platforms (AWS preferred) and production monitoring.
• Clear communication skills and a collaborative approach to problem-solving.

Culture & Benefits

• Promotion of a healthy work/life balance and flexible working hours.
• Comprehensive Pension Plan.
• Home, office, or commuting allowance.
• Generous vacation entitlement and option for sabbatical leave.
• Maternity, Paternity, Adoption and Family Care leave.
• Personal Choice budget and various employee discounts.
• Access to internal communities and networks.
• Employee Assistance Program (global).