Data Engineer (Lakehouse and AI Data Platform)

TL;DR

Data Engineer (Lakehouse and AI Data Platform): Design, build and support batch and streaming data pipelines and curated datasets on a modern Lakehouse platform with an accent on ingestion, transformation, modelling and data quality. Focus on developing reliable scalable data products for analytics, reporting and AI use cases using distributed processing frameworks like Spark and SQL.

Location: Onsite in London office, Greater London, England, United Kingdom

Company

Leading global investment banking, securities and investment management firm founded in 1869, headquartered in New York with offices around the world.

What you will do

• Build, enhance and support batch and streaming data pipelines on the Lakehouse and AI data platform.
• Refactor existing data flows to improve reliability, performance and maintainability.
• Develop raw, refined and curated datasets supporting analytics, reporting and AI use cases.
• Apply data modelling principles to represent business entities, relationships and historical changes.
• Implement data quality controls, validation and reconciliation across pipelines and datasets.
• Collaborate with engineers, platform teams and data consumers to deliver outcomes on time.

Requirements

• Bachelor’s or master’s degree in relevant discipline or equivalent experience with strong quantitative skills.
• Strong programming in Python or Java.
• Good SQL knowledge including troubleshooting, optimisation and analysis.
• Familiarity with software engineering fundamentals: version control, testing, CI/CD.
• Experience with distributed data processing like Apache Spark.
• Knowledge of data formats: JSON, Avro, Parquet; platforms like Snowflake, Databricks.

Culture & Benefits

• Engineering teams at the center of the business building scalable systems and solving complex problems.
• Commitment to diversity, inclusion, professional growth through training, networks and development opportunities.
• Best-in-class benefits including wellness programs, personal finance offerings and mindfulness support.
• Reasonable accommodations for candidates with special needs or disabilities.
• Equal opportunity employer.