Senior Data Engineer (AWS)

TL;DR

Senior Data Engineer (AWS): Designing and developing scalable data pipelines and Lakehouse architectures within a cloud-first environment with an accent on Apache Iceberg, ETL automation, and AWS ecosystem integration. Focus on building robust data workflows, ensuring system reliability, and implementing advanced data strategies to support strategic business objectives.

Location: Must be based in Porto, Portugal (Hybrid)

Company

A Swiss consulting firm specializing in strategic, technological, and organizational digital transformation for businesses.

What you will do

• Advise on data strategy and design architecture for cloud-first environments.
• Develop and maintain ETL processes and orchestration pipelines using Airflow and AWS Workflow.
• Implement and optimize Lakehouse architectures, specifically leveraging Apache Iceberg.
• Ensure security, reliability, and maintainability across all delivered data solutions.
• Collaborate with internal teams, participate in technical reviews, and support incident resolution.
• Document technical designs, implementation details, and operational guidelines.

Requirements

• 3-5 years of experience building data pipelines on public cloud platforms, preferably AWS.
• At least 1 year of professional experience in data solution architecture and development.
• Strong technical skills in Python, SQL, and Spark ecosystems.
• Proficiency in infrastructure as code and cloud foundation services (IAM, networking, storage).
• Hands-on experience with Lakehouse architectures, compaction, and data optimization.
• English proficiency required (written and spoken).

Nice to have

• Experience with Hudi, Delta, or Hadoop.
• Proficiency in Linux-based infrastructure and containerization (Docker).
• Knowledge of Azure or GCP platforms.
• French language skills.

Culture & Benefits

• Focus on career advancement and continuous professional growth.
• Supportive environment emphasizing training and skill development.
• Partnership-driven approach with a focus on transparency and trust.
• Commitment to digital transformation through innovation and creative thinking.