Principal Engineer - Databricks Data Engineer

Location: Hybrid, Guadalajara, Mexico

Company

Digital Product Engineering company building products, services, and digital experiences at scale across devices and digital mediums.

What you will do

• Audit and optimize Databricks workspaces, environments, clusters, catalogs, permissions, security configurations, and costs.
• Implement Unity Catalog, RBAC policies, namespace structures, access models, cluster policies, naming conventions, and environment segregation.
• Establish data governance frameworks covering data quality, ownership, SLAs, certification, lineage, stewardship, and compliance.
• Develop automation and Infrastructure as Code solutions for workspace operations, cluster lifecycle management, cost alerting, utilization monitoring, and platform administration.
• Build observability and performance dashboards for platform health, utilization, job success rates, costs, and data quality KPIs.
• Create runbooks, operational documentation, support procedures, architecture recommendations, and knowledge-transfer sessions for platform engineering teams.

Requirements

• Experience with Azure Data Factory, Databricks, and Unity Catalog.
• Ability to evaluate and optimize Databricks environments, including workspaces, clusters, catalogs, permissions, and security configurations.
• Ability to define and implement secure, scalable, and compliant platform governance standards.
• Ability to design data structures, access models, environment segregation strategies, RBAC policies, and user access processes.
• Ability to establish data quality frameworks, ownership models, SLAs, lineage, and stewardship practices.
• Ability to develop automation, Infrastructure as Code frameworks, observability dashboards, operational documentation, and runbooks.
• Ability to collaborate with security, compliance, infrastructure, and data engineering teams and provide training, mentoring, and knowledge transfer.

Nice to have

• Experience with data platform implementation.
• Experience with Google Workspace Administration.

Culture & Benefits

• Hybrid work arrangement in Guadalajara, Mexico.
• Dynamic, non-hierarchical work culture.
• Work within a global organization of more than 15,000 experts across 26 countries.