Data Engineer (Microsoft Fabric)

TL;DR

Data Engineer (Microsoft Fabric): Designing and optimizing scalable data products and pipelines for a digital trading ecosystem in the insurance sector with an accent on Microsoft Fabric, Spark, and Azure SQL. Focus on building an intelligent data hub, automating data workflows, and ensuring high availability of data pipelines.

Location: Lisbon, Portugal

Company

A market leader in digital solutions within the London insurance sector undergoing a major digital transformation.

What you will do

• Design, develop, and maintain scalable ETL/ELT data pipelines using Microsoft Fabric, Python Notebooks, Spark, and Azure SQL.
• Develop data models and optimize performance for analytics and reporting.
• Collaborate with visualization teams to ensure accurate data delivery via Power BI and Fusion Charts.
• Ensure data quality, integrity, and security across all data sources.
• Automate data workflows and ensure efficient orchestration of data processes.
• Monitor and troubleshoot data pipelines to ensure high availability and performance.

Requirements

• Minimum 3 years of experience as a Data Engineer focusing on Microsoft data technologies.
• Strong proficiency in Microsoft Fabric, Spark, Python Notebooks, PyMongo, WebApp, and Azure SQL.
• Experience with big data processing and warehousing (Databricks, Azure Data Lake, MirrorDB, Delta Lake).
• Familiarity with CI/CD pipelines and DevOps practices.
• Bachelor’s degree in Statistics, Mathematics, Computer Science or equivalent industry experience.
• Microsoft certification (DP-700 or DP-600) preferred.

Nice to have

• Exposure to MongoDB, schema-less data models, and change streams.
• Experience with AI models or MLOps.
• Exposure to Power BI and broader Microsoft Fabric technologies.

Culture & Benefits

• Permanent employment contract.