5 часов назад
Senior Data Engineer (Azure/Databricks)
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Azure/Databricks): Building scalable data pipelines and modern data platforms in Microsoft Azure and Databricks with an accent on Python-based processing, data architecture, and modelling. Focus on implementing Data Vault, Kimball, and 3NF models, managing schema evolution and slowly changing dimensions, and deploying reliable solutions through CI/CD.
Location: Remote within Spain; CET working hours.
Company
is an international consulting group specializing in innovation and business transformation through technology, with expertise in data, cloud, applications, and management consulting.
What you will do
- Design, develop, and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory and Azure Databricks.
- Build Python-based data processing and transformation solutions for large and complex datasets.
- Contribute to modern Azure data architectures using Medallion Architecture, Data Vault, and Business Vault principles.
- Work with Microsoft Fabric and OneLake, including shortcuts for cross-platform data integration.
- Contribute to data modelling in Azure Data Warehouse and related analytical environments.
- Collaborate with architects, developers, analysts, and stakeholders to improve scalability, performance, automation, security, and data governance.
Requirements
- Experience creating data pipelines with Python on Databricks.
- Experience with curated and product data layers and modelling techniques including Data Vault 2.0, Kimball dimensional modelling, and 3NF.
- Understanding of schema evolution, slowly changing dimensions, and data harmonisation.
- Practical experience with Declarative Automation Bundles for deployment.
- Practical experience with Git repositories and CI/CD pipelines, preferably GitHub and Azure DevOps.
- Experience developing pipelines in an IDE environment, preferably VS Code.
Nice to have
- Experience with Microsoft Fabric and OneLake shortcuts.
- Knowledge of data modelling in Azure Data Warehouse.
- Experience in financial services or wealth management.
- Familiarity with data governance, data quality, and modern cloud data architecture principles.
Culture & Benefits
- Remote work within Spain.
- Participation in a multicultural team and international projects.
- CET working hours.
- Access to projects across transport and logistics, financial services, energy and utilities, retail, and media and telecommunications.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →