Databricks Platform Architecture

Location: Onsite five days per week in Plano, Texas, or Alpharetta, Georgia, USA. No relocation is offered.

Salary: $155,400–$261,100 USD annually

Company

AT&T develops communications and technology solutions and uses data science, generative AI, and large-scale data assets to improve customer and business outcomes.

What you will do

• Define enterprise Databricks architecture, platform standards, and the technical roadmap across Azure and AWS.
• Design and administer Databricks accounts, workspaces, compute, SQL warehouses, serverless capabilities, networking, identity, monitoring, and workload isolation.
• Establish governance and secure data access through Unity Catalog and administer Azure Data Lake Storage.
• Implement and support Delta Lake, data ingestion and transformation, workflow orchestration, Databricks SQL, AI/ML, Genie, and Lakebase.
• Troubleshoot and tune platform performance while establishing compute policies, usage monitoring, and cost-optimization practices.
• Build repeatable provisioning and configuration with infrastructure as code, APIs, automation, and CI/CD, while partnering with architecture, security, cloud infrastructure, and engineering teams.

Requirements

• 7+ years of related experience, including substantial hands-on experience architecting and administering production Databricks environments.
• Deep production experience with Databricks across Azure and AWS, including account and workspace architecture, networking, identity, compute, and operational support.
• Strong Unity Catalog expertise and practical experience administering Azure Data Lake Storage, storage containers, permissions, and secure connectivity.
• Hands-on experience with Databricks serverless capabilities, workload tuning, troubleshooting, consumption management, and cost optimization.
• Practical implementation experience with Genie and Lakebase, plus knowledge of Databricks data engineering, SQL analytics, and AI/ML capabilities.
• Experience with infrastructure as code, CI/CD, Databricks APIs, Python, and SQL, along with the ability to establish standards and guide engineering teams.

Nice to have

• Master’s degree in Computer Science or a related field.
• Relevant Databricks and Azure/AWS certifications.

Culture & Benefits

• Medical, dental, and vision coverage.
• 401(k) plan, tuition reimbursement, paid time off, and paid holidays.
• Paid parental leave, caregiver leave, adoption reimbursement, and disability benefits.
• Life insurance, supplemental benefit programs, employee assistance, and wellness programs.
• Employee discounts on eligible AT&T mobility, internet, fiber, and phone services.