Senior Data Engineer (AI)

TL;DR

Senior Data Engineer (Python/Spark/Azure): Building and maintaining scalable data infrastructure and pipelines to support AI products and machine learning models with an accent on high-volume data processing and system reliability. Focus on designing ETL pipelines, optimizing unstructured data storage, and collaborating with ML engineers to enable data-driven decision-making.

Location: Abu Dhabi, United Arab Emirates

Company

hirify.global is an Abu Dhabi based joint venture between Presight and ADNOC focused on developing and commercializing AI products and applications for the energy sector.

What you will do

• Design and maintain highly scalable data pipelines focused on machine learning models and analytics.
• Develop and maintain APIs for data access and integration with external data services.
• Manage and optimize storage solutions for both structured and unstructured data (Text, Image, Audio, Video).
• Implement monitoring processes to ensure data quality, accuracy, and availability.
• Collaborate with ML engineers to provide architectural guidance and solve technical data issues.
• Maintain comprehensive documentation including data dictionaries, metadata, and architectural diagrams.

Requirements

• Bachelor’s degree in Computer Science, Engineering, Mathematics, or a related field.
• 7+ years of experience in a Data Engineering role.
• Proficiency in Python, Java, and Scala, with experience managing Terabyte to Petabyte scale data.
• Hands-on experience with big data technologies such as Hadoop, Spark, and Flink.
• Experience with Azure cloud platform, DevOps, CI/CD, and containerization (Docker, Kubernetes).
• Strong understanding of data warehousing concepts, ETL processes, and data modeling.

Nice to have

• Familiarity with machine learning frameworks such as TensorFlow or PyTorch.
• Experience with real-time and streaming data processing.

Culture & Benefits

• Access to cutting-edge AI infrastructure powered by the latest NVIDIA GPU cloud computing platform.
• Work with massive data sets and limitless computing, storage, and network resources.
• Innovative and entrepreneurial environment that encourages pushing boundaries.
• Opportunity to make meaningful and impactful contributions to AI applications in the energy world.