2 дня назад
Principal Data Architect (Databricks & AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Principal Data Architect (Databricks & AI): Defining and delivering a secure, scalable Databricks lakehouse foundation for trusted data use, advanced analytics, and AI with an accent on medallion architecture, data modeling, privacy, and governance. Focus on designing batch and streaming integrations, AI-ready data pipelines, vector search and RAG patterns, and resolving complex architecture and engineering challenges across product domains.
Location: London, United Kingdom — Canada Square. Applicants may be required to attend onsite interviews at a office.
Company
provides information, software, and data solutions that support professional and business decision-making.
What you will do
- Define the target data architecture, standards, reference patterns, and technical roadmap for a strategic enterprise data capability.
- Design a secure and scalable Databricks lakehouse using medallion architecture across Bronze, Silver, and Gold layers.
- Create canonical, dimensional, and semantic data models for consistent exchange and reuse across product domains.
- Architect batch, streaming, API, change-data-capture, and event-driven integrations.
- Design privacy-preserving and AI-ready data capabilities, including governed model-data pipelines, vector search, and retrieval-augmented generation patterns.
- Prototype solutions, review designs and code, optimize performance, and resolve complex technical issues while partnering with product, engineering, AI, security, platform, and business leaders.
Requirements
- Significant experience as a Data Architect, Lead Data Architect, Principal Data Engineer, or comparable senior technical leader.
- Advanced hands-on production experience with Databricks, lakehouse architecture, Delta Lake, governance, workflows, SQL, and optimization.
- Strong expertise in data privacy, security, masking, anonymization, tokenization, and sensitive customer-data environments.
- Deep experience with conceptual, logical, physical, dimensional, and canonical data modeling.
- Experience with batch and real-time integration, APIs, CDC, streaming, or event-driven pipelines.
- Strong data-engineering or software-development skills with Python, SQL, Scala, Java, and/or Spark, plus deep experience with Azure data services.
Nice to have
- Production AI/ML or generative-AI data architecture, including RAG, embeddings, vector search, or model-data pipelines.
- Knowledge of knowledge graphs, ontologies, RDF, linked data, or advanced semantic technologies.
- Databricks, cloud architecture, or data-engineering certification.
- Experience with dbt, Kafka, Airflow, Terraform, Power BI, Tableau, Collibra, or Microsoft Purview.
- Architecture experience across multiple products or regulated B2B software and information-service environments.
Culture & Benefits
- Shape a strategically important data foundation from the beginning.
- Make high-impact architectural decisions across products and business domains.
- Work on complex technical challenges involving trusted data, analytics, and AI.
- Mentor data engineers and architects and promote reusable platform capabilities and engineering standards.
Hiring process
- Participate in interviews without AI tools or external prompts.
- Interviews may include onsite participation at a office.
- Use of AI-generated responses or third-party support during interviews may result in disqualification.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
Data Principal (Hands-on Architect)
Databricks
4 дня назад
Delivery Solutions Architect (Data and AI)
5 дней назад
Data Platform Architect / Lead Data Engineer (AI)
3 дня назад
Data Engineer IV (AI)
3 дня назад
Data Engineer (AI)
3 дня назад
Data Solution Architect (Microsoft Analytics)
123 840 - 234 770$