Senior Data Architect (Databricks)

TL;DR

Senior Data Architect (Databricks): Designing and governing enterprise-scale data platforms and Lakehouse architectures with an accent on Unity Catalog, security, and performance optimization. Focus on architecting CI/CD pipelines, optimizing Spark workloads, and migrating legacy data platforms to cloud-native solutions.

Location: Hybrid in Princeton, New Jersey, United States

Company

A fast-growing digital technology service provider partnering with Fortune 1000 companies to drive innovative digital adoption.

What you will do

• Design scalable and secure Databricks Lakehouse architectures.
• Lead the implementation of data engineering, ingestion, transformation, and analytics frameworks.
• Define enterprise data governance and security standards using Unity Catalog (UC).
• Architect CI/CD, DevOps, monitoring, and automation for Databricks environments.
• Optimize Spark workloads, cluster utilization, and platform cost efficiency.
• Support the migration and modernization of legacy data platforms to Databricks.

Requirements

• Hands-on expertise in Databricks platform architecture.
• Experience with Unity Catalog (UC), RBAC, and access management frameworks.
• Deep knowledge of Spark, Delta Lake, PySpark, SQL, and distributed data processing.
• Experience with Azure Databricks or AWS Databricks environments.
• Proficiency in CI/CD, Terraform, and infrastructure-as-code.
• Must be based in or able to work hybrid in Princeton, New Jersey, United States.

Nice to have

• Exposure to AI/ML enablement within the Databricks ecosystem.
• Familiarity with Microsoft Purview, MDM platforms, and enterprise integration patterns.
• Experience in large-scale enterprise transformation programs.

Culture & Benefits

• Great Place to Work® certified employer.
• Focus on groundbreaking technologies and exclusive digital projects.
• Emphasis on nurturing the full potential of employees.

Hiring process

• The process may involve AI tools for reviewing applications and analyzing resumes to assist the recruitment team.
• Final hiring decisions are made exclusively by humans.