Назад
Company hidden
1 день назад

Lead Databricks Architect (AI)

Формат работы
onsite
Тип работы
fulltime
Грейд
lead
Английский
b2
Страна
Canada
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Lead Databricks Architect (AI): Designing and implementing enterprise-scale Databricks Lakehouse platforms and Data & AI products with an accent on cloud-native data engineering, governance, security, and scalable architecture. Focus on architecting batch and streaming pipelines, enabling ML/GenAI and RAG solutions, and leading complex client delivery across Azure, AWS, or GCP environments.

Location: Toronto, Canada

Company

hirify.global is a strategic AI partner for Fortune 500 companies, building enterprise Data & AI solutions.

What you will do

  • Lead client-facing architecture for enterprise Data & AI initiatives and translate business requirements into scalable solution architectures.
  • Design and implement Databricks Lakehouse platforms using Delta Lake, Unity Catalog, Workflows, Databricks SQL, MLflow, Delta Live Tables, Lakehouse Monitoring, and Mosaic AI.
  • Architect batch, streaming, near-real-time, and event-driven data pipelines, data products, ingestion, transformation, storage, consumption, and orchestration layers.
  • Define data governance, security, privacy, lineage, quality, observability, metadata, and operational monitoring standards.
  • Enable machine learning, GenAI, Agentic AI, RAG, model deployment, monitoring, and lifecycle management.
  • Lead cloud modernization and delivery across Azure, AWS, or GCP while mentoring engineering teams and supporting CI/CD, DevOps, Infrastructure-as-Code, and automation.

Requirements

  • 10+ years of experience in data engineering, analytics, cloud platforms, or enterprise data architecture, including 5+ years of hands-on Databricks architecture and implementation.
  • Proven experience leading architecture and technical delivery for enterprise data platforms and working directly with business stakeholders, product teams, and engineering organizations.
  • Deep expertise in Databricks Lakehouse Platform, Apache Spark, PySpark, SQL, Python, Delta Lake, Unity Catalog, and Databricks Workflows.
  • Experience building enterprise-scale batch and streaming solutions, multi-workspace Databricks deployments, and scalable, secure, cloud-native data platforms.
  • Strong understanding of data modeling, warehousing, governance, metadata management, data quality, master data management, data products, Lakehouse, Medallion, and Data Mesh concepts.
  • Strong experience with at least one of Microsoft Azure, AWS, or GCP; Azure is preferred. Experience with CI/CD, DevOps, Infrastructure-as-Code, automated deployment, Terraform, Git-based development, monitoring, logging, networking, security, authentication, and access management.
  • Experience designing platforms for machine learning and advanced analytics, with familiarity with MLflow, MLOps, model lifecycle management, and AI platform architectures.
  • Excellent communication, stakeholder management, and client-facing consulting skills, including leadership of distributed onsite/offshore delivery teams.

Nice to have

  • Experience with GenAI, RAG architectures, vector search, enterprise AI use cases, Fortune 500 clients, or regulated industries such as healthcare, life sciences, pharmaceuticals, distribution, or retail.
  • Databricks Certified Data Engineer Professional or equivalent Databricks certification, and Azure, AWS, or GCP certifications.
  • Experience with dbt, Kafka, APIs, Azure Data Factory, Azure Synapse Analytics, Snowflake, Power BI, Tableau, Collibra, Microsoft Purview, and Informatica.
  • Experience with enterprise data governance, data product operating models, AI/ML and GenAI transformations, and global onsite/offshore delivery models.

Culture & Benefits

  • Full-time employment in a client-facing architecture role with active involvement in execution and delivery.
  • Work with business stakeholders, product owners, data engineers, data scientists, enterprise architects, cloud platform teams, and distributed delivery teams.
  • Focus on scalable, governed, performant, secure, and business-aligned solutions, including cost optimization and FinOps practices.
  • Equal employment opportunities and a workplace committed to inclusion and non-discrimination.

Hiring process

  • The position is currently not eligible for immigration sponsorship.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →