Azure Databricks Engineer

Location: Anywhere in the UK. Hybrid working across company offices, client sites, and home; working from home 100% of the time is not permitted.

Company

hirify.global, part of the Capgemini Group, delivers technology solutions and consulting services that help clients implement innovation and create business value.

What you will do

• Implement, troubleshoot, monitor, and optimise Azure Databricks platforms, including serverless workloads, clusters, compute policies, and autoscaling.
• Develop Databricks SQL and Delta Lake solutions, ingestion and transformation pipelines, full and incremental loads, and CDC processes.
• Build integrations with REST APIs, databases, SaaS applications, cloud storage, and enterprise systems using secure authentication and credential management.
• Support Azure identity, networking, private endpoints, security, Key Vault, monitoring, and operational support.
• Implement FinOps practices including resource tagging, cost reporting, budget controls, and usage optimisation.
• Support production incidents, performance tuning, governance, application deployment, BI tooling integration, and migration activities.

Requirements

• Hands-on Azure Databricks platform engineering experience.
• Strong Python, PySpark, and SQL development skills.
• Experience designing data pipelines, implementing CDC, and managing data quality, schema evolution, reconciliation, and error handling.
• Experience with Azure identity and access management, networking, private endpoints, security, Key Vault, and monitoring.
• Experience supporting production environments, incident management, troubleshooting, performance tuning, and Agile delivery.
• Ability to work in the UK hybrid model across offices, client sites, and home.

Nice to have

• POSIT/RStudio migration experience.
• AI/ML and LLM integration experience.
• RAG and vector database exposure.
• Regulated industry experience.

Culture & Benefits

• Learning and development through training, think tanks, hackathons, and external certifications.
• Access to a broad course catalogue, including AWS, Microsoft, Harvard Management, and cybersecurity qualifications.
• Flexible working arrangements are available to UK employees.
• Inclusive recruitment support through the Disability Confident Employer scheme.
• Pre-employment checks include identity, nationality or immigration status, three years of employment history, and an unspent criminal record check.