This vacancy is archived
View similar vacancies ↓updated 16 days ago
Data Engineer (Azure)
Job description
Text:
TL;DR
Data Engineer (Azure/Databricks): Building and maintaining data pipelines for retail data delivery to the UK business unit with an accent on Azure Data Factory and Databricks. Focus on merging and cleansing data to provide a reliable curated data layer and implementing scalable data integrations.
Location: Must be based in Lisbon, Portugal
Company
is an international specialist insurer that focuses on unique risks and encourages a culture of challenging convention.
What you will do
- Design, implement, and maintain data integrations using Databricks and Azure Data Factory.
- Merge and cleanse data to establish a reliable and curated data layer.
- Collaborate with internal stakeholders to analyze and translate business requirements into technical solutions.
- Develop and maintain comprehensive documentation and provide training for self-service data usage.
- Monitor batch processes and troubleshoot root causes of failures.
- Refine business requirements into development tasks, estimating complexity and dependencies.
Requirements
- Proficiency in TSQL and experience with Microsoft Azure Data Lake Storage and Azure Data Factory.
- Hands-on experience with Databricks and core data engineering principles (ingestion, transformation).
- Understanding of CI/CD principles and a code-first development approach.
- Strong analytical skills and the ability to communicate effectively with diverse stakeholders.
- Fluent English (written and verbal) is required.
- Must be based in Lisbon.
Nice to have
- Computer Science degree or a data-related qualification.
- Experience with PowerBI or similar BI platforms.
- Experience working within the Insurance or Financial Services sector.
Culture & Benefits
- Culture that encourages thinking creatively and challenging the status quo.
- Collaborative environment with a focus on doing the right thing for customers and colleagues.
- Opportunity to work within an ambitious, evolving international business.
- Stable employment with a company boasting a long history of expertise.