AI Data Engineer (Azure)

TL;DR

AI Data Engineer (Azure): Designing and implementing data pipelines for AI and ML workloads within the agriculture and commodities domain with an accent on reliable data ingestion, transformation, and feature generation. Focus on building scalable ETL/ELT processes using Spark, Python, and Azure Synapse to support machine learning model training and inference.

Location: Worldwide (Remote, Hybrid, or Onsite)

Salary: EUR 3,425 - 5,400 per month (gross)

Company

hirify.global is a global technology services provider collaborating with industry leaders across various sectors including FinTech, Healthcare, and Retail.

What you will do

• Design and implement data pipelines for AI/ML workloads using Azure Data Factory and Synapse Analytics.
• Develop ETL/ELT processes using SQL, Python, and Spark for large-scale datasets.
• Build and manage pipelines for ML models, including data preparation and feature generation.
• Optimize storage and organization of structured/unstructured data in Azure Data Lake and Blob Storage.
• Collaborate with AI engineers and data scientists to ensure data quality and consistency across the ML lifecycle.
• Implement feature stores and data versioning strategies to enable reproducibility of ML experiments.

Requirements

• 4+ years of experience as a Data Engineer.
• Hands-on experience with Azure Data Factory and Azure Synapse Analytics.
• Strong proficiency in SQL, Python, and Spark for large-scale data processing.
• Experience with data ingestion and transformation specifically for AI/ML workloads.
• Knowledge of Azure Data Lake and Azure Blob Storage.
• English: Intermediate+ (B1) or above required.

Culture & Benefits

• Flexible work format: fully remote, hybrid, or office-based.
• Professional growth through mentoring, adaptation systems, and a comprehensive corporate training portal.
• Financial and career growth opportunities, including compensation for certifications (AWS, PMP, etc.).
• Private health insurance and compensation for sports activities.
• Vibrant corporate life with parties, snacks, and entertainment.
• Referral program and English language courses.