Databricks Data Architect (AI/RAG)

TL;DR

Databricks Data Architect (AI/RAG): Designing and owning a Master Data Management platform that consolidates application data into a single source of truth, with an AI layer for clean, connected, and enriched data. Focus on building reference pipelines and data models, defining explainable incident/risk/compliance data patterns, and implementing AI/RAG approaches using Databricks and cloud infrastructure.

Location: Office/remote in Poland

Company

hirify.global supports a client building a unified Master Data Management platform with an AI layer.

What you will do

• Own the platform architecture for Master Data Management and incident/risk/compliance use cases.
• Build reference ETL/ELT pipelines and data models on Databricks.
• Define semantic layer and governance using Unity Catalog metric views.
• Design knowledge graph approaches (GraphFrames) and connected data representations.
• Define AI/RAG patterns together with engineering and implement AI/vector search and AI search capabilities.
• Collaborate on cloud infrastructure architecture across AWS/Azure/GCP.

Requirements

• Hands-on architecture experience with Databricks (Spark, PySpark, SQL, Delta Lake, Unity Catalog).
• Strong ETL/ELT and data modeling skills, including semantic layer design.
• Experience implementing RAG/LLM tooling and vector/AI search (vector search, AI search).
• Knowledge of knowledge graphs (GraphFrames) and connected data modeling.
• Experience with cloud infrastructure (AWS/Azure/GCP) for data platforms.
• Ability to work from Poland (office/remote setup).

Culture & Benefits

• Hands-on architecture role with ownership of platform design.
• Collaboration with engineering to define AI/RAG patterns and implement data pipelines.
• Work on explainable, trustworthy data for incident management, risk assessment, and regulatory compliance.