Azure Databricks Technical Lead

Location: Anywhere in the UK; hybrid working across company offices, client sites, and home, with no 100% home working.

Company

hirify.global, part of the Capgemini Group, delivers custom technology solutions and digital transformation services for clients.

What you will do

• Implement, configure, troubleshoot, and optimise Azure Databricks platforms, including Serverless, Databricks SQL, Delta Lake, clusters, compute policies, autoscaling, and monitoring.
• Design and build full and incremental ingestion and transformation pipelines with CDC, data quality controls, schema evolution, reconciliation, and error handling.
• Develop integrations with REST APIs, databases, SaaS applications, cloud storage, and enterprise systems using secure authentication and credential management.
• Manage Azure identity, access, networking, private endpoints, security, Key Vault, monitoring, and operational support.
• Implement FinOps practices including resource tagging, cost monitoring, reporting, budget controls, and usage optimisation.
• Support production operations, application deployment, BI tooling integration, scheduling, and POSIT/RStudio migration activities.

Requirements

• Hands-on experience implementing and troubleshooting Azure Databricks and supporting production environments.
• Strong Python, PySpark, and SQL development skills.
• Experience with monitoring, incident management, troubleshooting, performance tuning, operational governance, and platform standards.
• Experience integrating Azure services, APIs, databases, SaaS applications, cloud storage, and enterprise systems.
• Experience collaborating with Data Engineers, Data Scientists, and Platform Teams, including technical documentation, knowledge transfer, and Agile delivery.
• Ability to work in the UK hybrid model and complete pre-employment identity, nationality or immigration, employment history, and criminal record checks.

Nice to have

• POSIT/RStudio migration experience.
• AI/ML and LLM integration, RAG, or vector database exposure.
• Experience in regulated industries.

Culture & Benefits

• Hybrid-first working with flexible working arrangements available to UK employees.
• Learning and development through training, think tanks, hackathons, external certifications, and access to extensive online courses.
• Inclusive recruitment practices through the Disability Confident Employer scheme.
• Opportunities to work with international technology, engineering, data, and transformation experts.