Lead Data Engineer (Azure)

Location: On-site at hirify.global Head Office in Enderby, Leicestershire

Company

hirify.global is an eCommerce and retail business developing data capabilities for analytics, reporting, machine learning, and generative AI.

What you will do

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Azure Databricks, Azure Data Lake Storage, PySpark, and SQL.
• Design and evolve enterprise data models that support analytics, machine learning, generative AI, and advanced analytics.
• Implement data quality, security, governance, monitoring, and operational best practices.
• Build streaming data solutions and Delta Live Tables with PySpark and Databricks.
• Develop CI/CD pipelines and integrate third-party systems and APIs for reliable data ingestion.
• Mentor junior engineers, collaborate with stakeholders, and lead technical decisions focused on performance, reliability, scalability, and business value.

Requirements

• Strong Python, PySpark, and SQL skills with extensive experience building and optimising large-scale data pipelines.
• Hands-on experience with Azure Databricks, Azure Data Factory, Azure Data Lake Storage, and Delta Lake.
• Experience with relational and NoSQL databases, including Cosmos DB, plus streaming pipelines and Delta Live Tables.
• Strong knowledge of modern data modelling, data governance, data quality, security, and operational practices.
• Experience with Azure DevOps, Git, CI/CD, third-party APIs, and external data sources.
• Strong problem-solving, communication, stakeholder management, commercial awareness, and technical leadership skills.

Nice to have

• Knowledge of machine learning, MLOps, and AI data products.
• Experience preparing data for large language models and retrieval-augmented generation solutions.
• Experience with AWS or GCP and enterprise data governance frameworks.

Culture & Benefits

• Company performance-based bonus and Sharesave scheme.
• Employee discounts across hirify.global and partner brands.
• On-site nursery, parking, restaurants, and access to digital GP and wellbeing services.
• Financial wellbeing support, apprenticeship opportunities, support networks, and discounted gym memberships.