Lead Data Engineer (Azure)

TL;DR

Lead Data Engineer (Azure/Python): Designing and implementing end-to-end data architectures and cloud-native pipelines with an accent on ingestion, modeling, and orchestration. Focus on optimizing pipelines for performance and cost, implementing DataOps practices, and providing technical leadership to engineering teams.

Location: Hybrid (2 times a week in the Lisbon office). Requires Portuguese or other EU citizenship, or a valid Portuguese work permit.

Company

A tech consultancy firm that matches skilled professionals with national and international partners across various technology sectors.

What you will do

• Design and implement end-to-end data architecture, including ingestion, modeling, storage, and orchestration.
• Develop cloud-native engineering solutions utilizing Microsoft Fabric, Azure Data Factory, and Synapse.
• Manage and optimize data warehousing and data lake solutions such as BigQuery, Azure Data Lake, and Delta Lake.
• Optimize pipelines and storage solutions to ensure high performance, reliability, and cost-efficiency.
• Implement data validation, lineage, documentation, and monitoring at scale.
• Provide technical leadership and guide teams to ensure effective communication and delivery.

Requirements

• Minimum 8 years of experience in data engineering with a focus on cloud-native solutions.
• Proficiency in Python (Pandas, Boto3), SQL, and Spark.
• Strong experience with RDBMS (Oracle, MS SQL Server) or NoSQL databases (MongoDB, ElasticSearch).
• Experience with DevOps/DataOps practices and CI/CD pipelines.
• English proficiency: B2 level required.
• Must be based in Lisbon (hybrid) and possess EU citizenship or a valid Portuguese work permit.

Culture & Benefits

• Personalized support through a dedicated career coach.
• Health insurance and Coverflex meal card.
• Opportunities for professional career progression.
• Welcome kit and access to special discounts/protocols.
• Commitment to employee well-being and work-life balance.