Principal Data Engineer (Databricks)

Location: London, England, United Kingdom; Workplace: Hybrid

Company

hirify.global is an independent technology consultancy building modern data platforms, intelligent systems, and bespoke software for enterprises, scale-ups, and government clients.

What you will do

• Own the end-to-end architecture and technical direction of cloud-native data platforms.
• Design and deliver greenfield platforms using Databricks, Snowflake, AWS, and GCP.
• Build and optimise batch and real-time pipelines with Kafka, Flink, Kinesis, Pub/Sub, Airflow, Dataflow, and Glue.
• Process large datasets with Spark and Flink and optimise relational, NoSQL, and analytical storage.
• Work directly with clients to translate business needs into pragmatic engineering decisions.
• Set engineering standards, review designs and code, mentor engineers, and improve data quality, testing, observability, and operational excellence.

Requirements

• Strong Python and SQL skills with deep experience in Spark and modern data platforms such as Databricks and Snowflake.
• Experience designing and operating large-scale data platform architectures and production data pipelines.
• Strong data modelling and architectural decision-making skills, including performance, cost, and complexity trade-offs.
• Experience with AWS or GCP, multiple storage technologies, and formats such as Parquet, Delta, ORC, and Avro.
• Infrastructure-as-code experience with Terraform or Pulumi and CI/CD using GitHub Actions or ArgoCD.
• Experience with data testing and quality frameworks such as dbt, Great Expectations, or Soda, plus consulting or professional services experience.

Culture & Benefits

• Work on interesting, high-impact data and technology problems.
• Build modern platforms rather than maintain legacy systems.
• Collaborate with senior engineers and work in small, high-calibre teams.
• Receive autonomy, technical influence, and room to grow.