2 дня назад
Principal Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Principal Data Engineer (Databricks): Building and scaling Databricks-based data pipelines and models that provide trusted data for analytics, data science, and operational decision making with an accent on AWS cloud engineering, data quality, governance, and observability. Focus on designing production-grade batch and real-time solutions, solving complex platform challenges, and providing technical leadership and mentorship.
Location: Hybrid role based in London, UK — , 47–53 Charterhouse Street, Farringdon, London, EC1M 6PB
Company
is building a data-driven energy organisation where trusted data supports customer service, strategic decisions, analytics, and operational delivery.
What you will do
- Design, build, and optimise scalable data pipelines and data models on Databricks.
- Integrate batch and streaming data sources while meeting reliability and performance SLAs.
- Improve data quality, observability, governance, security, and operational standards.
- Own complex engineering problems and contribute to the evolution of the data platform architecture.
- Provide technical leadership within delivery teams and influence engineering decisions with senior stakeholders.
- Coach and mentor Data Engineers while promoting reusable patterns, peer review, and engineering best practices.
Requirements
- At least 5 years of experience as a Data Engineer or in a similar data-focused role, including at least 1 year as a Senior Data Engineer.
- Strong experience with AWS, Databricks and/or Spark, Python, and SQL.
- Knowledge of cloud data engineering design, data modelling, database design, and data warehousing.
- Experience delivering production-quality extraction, transformation, aggregation, and repeatable data pipeline solutions.
- Understanding of data governance, data quality, data cataloguing, and associated tools.
- Strong problem-solving, stakeholder management, technical ownership, autonomy, and communication skills.
Nice to have
- Experience with data migration projects.
- Experience coaching or mentoring Data Engineers.
- Experience with streaming or real-time data at scale.
- Experience in the energy sector or another complex, data-rich environment.
Culture & Benefits
- Hybrid and family-friendly working policies.
- 26 days of annual leave plus bank holidays, pension, life cover, bonus opportunities, and flexible benefits.
- Excellent parental leave and support including fertility-friendly and menopause-friendly policies.
- Inclusive workplace with disability adjustments and guaranteed interviews for disabled applicants meeting the minimum criteria.
- Development programmes, inclusive talent networks, and opportunities for professional growth.
- Successful candidates must complete a basic DBS check.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
8 дней назад
Principal Data Architect (Databricks & AI)
5 дней назад
Senior Data Engineer (AI)
6 дней назад
Senior / Lead Developer - DataBricks | Data Factory | SQL
5 дней назад
Senior Data Engineering Consultant (Databricks)
9 дней назад
Senior Data Engineer (AWS)
70 000 - 85 000GBP
4 дня назад