Lead Data Engineer (Azure)

TL;DR

Lead Data Engineer (Azure): Building and optimizing large-scale lakehouse and warehouse analytics systems for game studio decision-making with an accent on ETL processes and real-time data feeds. Focus on designing scalable pipelines using Databricks and Azure Synapse, and implementing AI/ML data engineering use cases like feature stores.

Location: Remote (USA)

Company

hirify.global is a global technology consulting firm providing AI and data engineering services.

What you will do

• Build state-of-the-art data pipelines and models to drive studio decision-making processes.
• Develop scalable ETL processes and data movements using Databricks and Azure Data Factory.
• Manage large-scale lakehouse and warehouse analytics systems for real-time and batch processing.
• Collaborate with business, design, test, and development teams to optimize data capture and driven development.
• Apply AI/ML to data engineering use cases, including feature engineering and model monitoring pipelines.

Requirements

• Must be based in the United States
• 5+ years of experience with SQL.
• 5+ years of experience designing and implementing scalable ETL processes.
• 3+ years of experience with Big Data Analytics (Data Lake, Spark, Parquet).
• 2+ years of experience building cloud-hosted data systems, preferably in Azure.

Nice to have

• Experience building data pipelines in Azure Databricks, Fabric, or Spark.
• Proficiency with Delta Lake format and Azure Data Explorer/Kusto.
• Experience preparing datasets for modern AI applications (LLM/RAG, A-B testing).