Senior Data Engineer (Big Data)

TL;DR

Senior Data Engineer (Big Data): Designing and maintaining highly scalable data pipelines for GenAI-driven analytics with an accent on large-scale data processing and infrastructure optimization. Focus on implementing ETL processes for terabyte-to-petabyte scale data and integrating streaming technologies like Flink and Spark.

Location: Abu Dhabi, United Arab Emirates

Company

hirify.global is a leading big data analytics company powered by GenAI, focused on creating business and societal impact through all-source data interpretation.

What you will do

• Design, construct, and maintain highly scalable data pipelines focused on machine learning models and analytics.
• Manage and optimize storage solutions for both structured and unstructured data, including text, image, audio, and video.
• Develop and maintain APIs for data access and manipulation and integrate external data services.
• Implement processes to monitor data quality and ensure production data accuracy for stakeholders.
• Collaborate with ML engineers to provide architectural guidance and solve data-related technical issues.
• Maintain comprehensive documentation, including data dictionaries and architectural diagrams.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or equivalent experience.
• 7+ years of experience in a Data Engineering role.
• Proficiency in Python and SQL for managing data at Terabyte to Petabyte scale.
• Hands-on experience with big data technologies such as Spark (PySpark/Scala) and Flink.
• Strong understanding of Data Lake-house concepts, ETL processes, and data modeling.
• Experience with Azure cloud platform.

Nice to have

• Familiarity with machine learning frameworks like TensorFlow or PyTorch.
• Knowledge of DevOps, CI/CD methods, and containerization (Docker, Kubernetes).
• Experience with real-time and streaming data processing.

Culture & Benefits

• Work at a leading ADX-listed public company at the forefront of Applied AI.
• Opportunity to work with cutting-edge GenAI-driven products.
• Collaborative environment involving cross-functional teams of data scientists and ML engineers.