Data Engineer (Spark)

TL;DR

Data Engineer (Spark): Building and optimizing scalable data pipelines and distributed systems with an accent on high-volume data processing. Focus on implementing distributed architectures using Spark, Hadoop, and Kafka to ensure efficient data flow and system reliability.

Location: Hybrid (2 days/week in Lisbon). Must be based in Portugal with Portuguese/EU citizenship or a valid work permit.

Company

A tech consultancy focusing on matching specialized professionals with diverse national and international partners.

What you will do

• Develop and maintain scalable data processing pipelines using Apache Spark.
• Manage and optimize distributed systems including Hadoop, Hive, and Kafka.
• Implement robust server-side logic utilizing Scala or Java.
• Orchestrate complex data workflows using tools such as Control-M.
• Collaborate as a consultant across various tech sectors to deliver data engineering solutions.

Requirements

• Degree in Computer Science, Software Engineering, or an equivalent field.
• 3+ years of professional experience as a Data Engineer.
• Proficiency in Spark, distributed systems (Hadoop/Hive/Kafka), and Scala or Java.
• English: B2 level or above is mandatory.
• Must be based in Portugal with valid work authorization.

Nice to have

• Experience with Spring Boot.
• Experience with orchestration tools like Control-M.
• Fluency in French (B2 level or above).

Culture & Benefits

• Access to a broad network of international partners and diverse tech projects.
• Personalized career support through a dedicated career coach.
• Health insurance and Coverflex meal card.
• Welcome kit and clear opportunities for career progression.
• Strong emphasis on work-life balance and employee well-being.