Data Engineer (Lakehouse and AI Data Platform)

TL;DR

Data Engineer, Lakehouse and AI Data Platform: design, build, test and support data pipelines and curated datasets on the firm’s modern data platform with an accent on ingestion, transformation, modelling, optimisation and data quality. Focus on developing raw, refined and curated datasets for analytics, reporting and AI use cases, implementing controls for data validation and partnering with stakeholders for reliable delivery.

Location: London office

Company

Leading global investment banking, securities and investment management firm headquartered in New York with offices around the world.

What you will do

• Build, enhance and support batch and streaming data pipelines on the Lakehouse and AI data platform.
• Refactor existing data flows to improve reliability, performance and maintainability.
• Develop raw, refined and curated datasets supporting analytics, reporting and AI use cases using sound data modelling principles.
• Implement data quality controls, reconciliation and monitoring standards.
• Collaborate with engineers, platform teams and data consumers to deliver outcomes on time.

Requirements

• Bachelor’s or master’s degree in relevant discipline or equivalent experience with strong quantitative skills.
• Strong programming in Python or Java; good SQL knowledge including optimisation.
• Experience with distributed data processing like Apache Spark; data formats JSON, Avro, Parquet.
• Understanding of temporal data modelling, schema design, partitioning and data quality practices.
• Software engineering fundamentals: version control, testing, CI/CD.
• Experience building production data pipelines in collaborative environments.

Culture & Benefits

• Positioned at the centre of the business, building scalable systems and solving complex problems.
• Training, development opportunities, firmwide networks and personal growth programs.
• Best-in-class benefits including wellness, personal finance offerings and mindfulness programs.
• Commitment to diversity, inclusion and reasonable accommodations for candidates with disabilities.