Data Engineer (Junior-Mid) (PySpark)

TL;DR

Data Engineer (PySpark): Developing and optimizing scalable data pipelines and ETL/ELT processes with an accent on distributed computing and orchestration. Focus on building robust data workflows using PySpark, Spark SQL, and Apache Airflow to ensure data quality and consistency.

Location: Hybrid in Athens, Greece

Company

hirify.global is a European professional services firm dedicated to responsible digitalisation for public and private organisations.

What you will do

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Write and maintain SQL queries for efficient data extraction, transformation, and loading.
• Process and analyze datasets in distributed computing environments using PySpark and Spark SQL.
• Schedule and monitor data workflows utilizing Apache Airflow.
• Collaborate with business analysts and data architects to ensure seamless data integration.
• Implement data validation mechanisms to maintain high data quality and consistency.

Requirements

• At least 1 year of experience in data engineering.
• Experience working with cloud platforms such as MS Azure, AWS, or GCP.
• Bachelor's degree in Computer Science, Information Systems, or a related field.
• Proficiency in SQL and experience with relational databases (e.g., Oracle, PostgreSQL, SQL Server).
• Basic experience with PySpark and Spark SQL for dataset processing.
• Understanding of Apache Airflow and ETL/ELT principles.

Nice to have

• Familiarity with Python or Bash for automation and data manipulation.
• Experience with NoSQL databases like MongoDB or Cassandra.

Culture & Benefits

• Hybrid working model providing flexibility between home and modern offices.
• Seamless onboarding experience with a dedicated buddy.
• Competitive compensation package including health and life insurance.
• Meal and commuting allowances.
• Continuous learning opportunities with unlimited access to Udemy for Business.
• Personalized development plans for targeted career growth.