TL;DR

Senior Data Engineer: Designing, developing, and implementing scalable ETL processes and big data solutions with an accent on Apache Spark, PySpark, and Airflow. Focus on managing large datasets, cloud-based data processing, and collaborating with cross-functional teams to meet business requirements.

Location: Cairo, Egypt

Company

%hirify_global% is a global technology company providing a full spectrum of services including business and tech advisory, enterprise solutions, CX, UX and UI design, managed services, product development, and software development.

What you will do

Design, develop, and implement scalable and efficient ETL processes using Apache Spark and PySpark
Utilize Airflow to manage and schedule data pipelines and workflows
Work with large datasets in various formats including DataFrames and Parquet files
Collaborate with cross-functional teams to design and develop big data solutions that meet business requirements
Work independently and solve complex problems with strong analytical skills

Requirements

Location: Must be based in Cairo, Egypt
Experience with Apache Spark, PySpark, Python, SQL, and Airflow
Strong problem-solving and analytical skills
Preferred experience with IBM Cloud (Cirrus) for cloud-based data processing and storage
Ability to work independently and collaborate with teams

Hiring process

Application review
Talent acquisition interview to discuss goals and company support
Technical interview focusing on expertise and problem-solving
Customer interview for client-aligned roles
Job offer and onboarding