Senior Databricks Data Engineer (AI)

Location: Dublin, County Dublin, Ireland; hybrid workplace

Company

hirify.global delivers technology and transformation solutions for global brands and partners with Microsoft, AWS, Oracle, Red Hat, OutSystems, and Snowflake.

What you will do

• Design and build scalable ETL/ELT, AI, and Generative AI pipelines using Databricks, PySpark, Delta Lake, and SQL.
• Develop and maintain Bronze, Silver, and Gold Lakehouse architectures, Delta Live Tables, Databricks Workflows, and job orchestration.
• Create production-grade RAG pipelines, multi-agent workflows, AI agent frameworks, feature stores, and AI training datasets.
• Support MLOps through model training and inference pipelines with MLflow.
• Implement data quality monitoring, governance, metadata management, and event-driven integrations across Azure services.
• Contribute to engineering best practices and centre of excellence initiatives while mentoring engineering teams in AI technologies.

Requirements

• Strong experience as a Data Engineer, AI Engineer, Machine Learning Engineer, or in a similar role.
• Hands-on experience building and deploying production-grade multi-agent AI workflows, RAG solutions, AI agent frameworks, and Databricks data pipelines.
• Strong Python and SQL programming skills, with experience in Apache Spark and distributed data processing.
• Experience implementing Generative AI solutions within Databricks Workflows and Jobs and strong knowledge of Databricks Lakehouse architecture.
• Hands-on experience with Delta Lake, Unity Catalog, Databricks Workflows, and MLflow.
• Experience with event-driven integrations using Azure Service Bus, Azure Functions, and Azure Databricks.
• Understanding of data modelling, Medallion/Lakehouse architecture, Git-based version control, and CI/CD practices.
• Strong understanding of AI/ML pipelines, including data preparation, feature engineering, and model deployment.
• Excellent English communication skills.

Nice to have

• PyTorch and/or TensorFlow experience.
• Event Hub, Logic Apps, and enterprise-scale AI platform experience.
• Experience mentoring engineering teams or leading technical initiatives.
• Exposure to financial services or highly regulated environments.
• Advanced LLMOps experience, including prompt tracking, trace logging, and regression benchmarking.

Culture & Benefits

• Flexible and remote working options supporting work-life balance.
• Quarterly performance-related profit share scheme.
• Career progression, mentorship coaching, and quarterly career development programmes.
• Pension, private healthcare, life assurance, financial advice, employee discounts, and wellbeing schemes.
• Generous holiday allowance, enhanced maternity/paternity leave, educational assistance, and incentivised certifications.
• Equal opportunities workplace with diversity, inclusion, accessibility, and reasonable adjustments available throughout recruitment.