Mid Data Engineer (Big Data)

TL;DR

Mid Data Engineer (Big Data): Developing batch and real-time data pipelines using Python and PySpark to translate business needs into scalable production-ready solutions. Focus on optimizing data processing workflows and implementing advanced Python OOP patterns.

Location: Hybrid (2x a week), must be based in Porto or Lisbon, Portugal. Requires Portuguese or EU citizenship, or a valid work permit.

Company

A tech consultancy focusing on matching specialists with diverse national and international partners across various sectors of the technology industry.

What you will do

• Develop and optimize batch and real-time data pipelines using PySpark.
• Translate business requirements into scalable, production-ready data solutions.
• Implement data processing logic using advanced Python (OOP, pandas) and testing.
• Collaborate with cross-functional teams to ensure high-quality data architecture and reliability.

Requirements

• 5 to 7 years of experience as a Data Engineer.
• Advanced Python (OOP, pandas, testing) and strong PySpark expertise.
• English: B2 minimum.
• Must be based in Portugal with EU citizenship or a valid work permit.

Culture & Benefits

• Welcome kit and comprehensive health insurance.
• Coverflex meal card and various special discounts.
• Personalized career coaching and professional growth opportunities.
• Strong focus on work-life balance and employee well-being.