Data Engineer (BigData)

TL;DR

Data Engineer (BigData) (Hadoop/Python/PySpark): Building and maintaining Big Data pipelines and data platforms with an accent on NoSQL technologies, data modeling, deployment automation, and analytical data processing. Focus on designing scalable data workflows, integrating Hadoop-based systems, and delivering reliable solutions in an agile international environment.

Location: Hybrid in Porto, Portugal

Company

hirify.global is a Portugal-based IT consulting company with 18 years of experience, providing technology advisory and delivery services through an agile, people-centered team.

What you will do

• Build and maintain Big Data solutions using Hadoop, HDFS, Hive, Kerberos, and Starburst.
• Develop data processing workflows with Python and PySpark.
• Apply data modeling principles and SQL to structure and analyze data.
• Manage source code, build, and deployment processes using Git, Jenkins, XL Deploy, and XL Release.
• Collaborate with distributed international teams using agile methodologies such as Scrum and Kanban.
• Analyze data patterns, trends, seasonality, and other behaviors.

Requirements

• At least 4 years of professional experience with Big Data and NoSQL technologies.
• Professional experience with Hadoop, HDFS, Hive, Kerberos, and Starburst.
• Experience with Python, PySpark, Visual Studio Code or similar tools.
• Knowledge of data modeling principles and SQL.
• Familiarity with DevOps concepts, Git, Jenkins, XL Deploy, and XL Release.
• English at B2 level or higher is mandatory.

Culture & Benefits

• No-term full-time employment contract.
• Health insurance and 22 days of paid vacation.
• Four additional annual days off for Carnival, Christmas Eve, New Year's Eve, and the employee's birthday.
• Meal allowance, referral bonus, discounts, and flexible options.
• Annual training budget and opportunities to grow through challenging projects.
• Team-oriented culture within a dynamically growing international company.