Senior Data Engineer (Databricks)

TL;DR

Senior Data Engineer (Databricks): Designing and building scalable data ingestion and processing solutions for a cloud-based Lakehouse with an accent on enterprise-grade data assets and architecture. Focus on operationalizing Agentic AI and ML models, optimizing data pipelines, and implementing vector stores for LLM deployments.

Company

hirify.global is a global insurance company with 53,000 employees worldwide, providing risk protection for millions of individuals and businesses.

What you will do

• Design and build scalable solutions to ingest, store, and process large volumes of structured, semi-structured, and unstructured data into a cloud-based Lakehouse.
• Build enterprise-grade, highly reusable data assets for analytics consumption.
• Develop conceptual, logical, and physical data architecture blueprints to create a single source of truth for the enterprise.
• Partner with analytics experts, data scientists, and analysts to develop self-service experiences within the data democratization platform.
• Take ownership of the operationalization of Agentic AI & ML models, including the optimization of data pipelines, model deployment, and monitoring.

Requirements

• Experience with Azure or AWS Cloud.
• Proven experience in building enterprise-grade Data & AI solutions.
• Proficiency with Microsoft Azure services, specifically Fabric, Databricks, Data Factory, Cosmos DB, AI Foundry, and Power BI.
• Experience with vector stores such as Elastic, Pinecone, Mongo Atlas, or Redis.
• Experience with cloud data warehouse solutions like Snowflake, Fabric, or Redshift.
• Exposure to ML frameworks (TensorFlow, PyTorch, Scikit-Learn) and LLM deployment pipelines, including embeddings and prompt engineering.

Culture & Benefits

• Attractive compensation scheme and benefits above the legal requirements.
• Food and restaurant vouchers.
• Life insurance and major medical expenses insurance.
• Commitment to equal opportunity employment and diversity.
• A challenging and inspiring work environment supported by a world-class team.