Data Engineer

TL;DR

Data Engineer (Python/PySpark): Ingest and onboard datasets from various sources to build scalable ETL/ELT pipelines that power analytics and operational workflows with an accent on data modeling, quality assurance, and observability. Focus on operationalizing data entities, automating refreshes, and collaborating with analysts and product teams to define data contracts and SLOs.

Location: London, England. Flexible hybrid work environment

Company

hirify.global provides enterprise data management solutions powering investment intelligence for over US$75 trillion in assets under management.

What you will do

• Ingest and onboard datasets from internal systems, APIs, databases, files, external providers, and real-time feeds.
• Build and operate scalable ETL/ELT pipelines using Python, PySpark, SQL, and Foundry tooling; schedule batch/stream refreshes.
• Model and operationalize data entities and relationships for analytics and operational applications.
• Implement data quality checks, testing, observability, alerting, lineage, and access controls.
• Collaborate with analysts and product teams to translate requirements into data solutions and contracts/SLOs.

Requirements

• 1-3 years in data engineering or analytics engineering with end-to-end production pipeline delivery.
• Proficiency in Python and PySpark for distributed data processing.
• Strong SQL for analytical and transformation logic.
• Data modeling for analytics and operational use cases.
• Experience ingesting data from APIs, databases, external feeds, and real-time sources.
• Grasp of data quality, testing, observability, lineage, and governance practices.
• Comfort with large datasets and modern ELT patterns on distributed compute.

Nice to have

• Palantir Foundry: pipelines, transforms, Code Repos, Ontology, operational applications.
• Spark concepts: partitions, shuffles, caching, performance optimization.
• Databricks or cloud-native compute.
• Financial or enterprise operational data experience.
• AI-assisted ETL/ELT or data quality tooling.
• Streaming frameworks or orchestration tools.

Culture & Benefits

• 28 days annual leave.
• AXA Gym Membership Discount.
• Healthshield Cashback plan and Perks platform.
• MetLife Afterlife Support and 24-hour virtual GP service.
• Annual ‘purchase holiday’ scheme.
• Chubbs Travel Insurance.
• Competitive pay and bonus eligibility.
• Flexible hybrid work environment.