Senior Data Engineer

TL;DR

Senior Data Engineer: Designing, developing, and implementing scalable ETL processes and big data solutions with an accent on Apache Spark, PySpark, and Airflow. Focus on managing large datasets, cloud-based data processing, and collaborating with cross-functional teams to meet business requirements.

Location: Cairo, Egypt

Company

hirify.global is a global technology company providing a full spectrum of services including business and tech advisory, enterprise solutions, CX, UX and UI design, managed services, product development, and software development.

What you will do

• Design, develop, and implement scalable and efficient ETL processes using Apache Spark and PySpark
• Utilize Airflow to manage and schedule data pipelines and workflows
• Work with large datasets in various formats including DataFrames and Parquet files
• Collaborate with cross-functional teams to design and develop big data solutions that meet business requirements
• Work independently and solve complex problems with strong analytical skills

Requirements

• Location: Must be based in Cairo, Egypt
• Experience with Apache Spark, PySpark, Python, SQL, and Airflow
• Strong problem-solving and analytical skills
• Preferred experience with IBM Cloud (Cirrus) for cloud-based data processing and storage
• Ability to work independently and collaborate with teams

Hiring process

• Application review
• Talent acquisition interview to discuss goals and company support
• Technical interview focusing on expertise and problem-solving
• Customer interview for client-aligned roles
• Job offer and onboarding