Staff Designated Support Engineer (Apache Spark)

Location: Sydney, Australia

Company

Databricks provides a unified Data + AI Platform used by more than 20,000 organisations worldwide to build and scale data, AI, analytics, and agent applications.

What you will do

• Provide high-touch specialised support and tailored technical solutions for strategic Digital Native Business customers.
• Perform advanced troubleshooting and root cause analysis for performance and reliability issues across Spark, SQL, Delta, Streaming, and Databricks runtime features.
• Define continuous monitoring requirements and collaborate with R&D and NOC teams to optimise customer environments.
• Build rapid POCs and test, deploy, and monitor solutions developed by Databricks Engineering for customer challenges.
• Create playbooks and maintain knowledge bases covering Spark, ML, and AI workflows.
• Train customer teams, advocate for customers in business reviews, and collaborate with Field Engineering, Sales, and Product during customer engagements.

Requirements

• 10+ years of experience designing, building, and troubleshooting distributed computing applications.
• 4+ years delivering production-scale Spark, ML, or AI solutions using Python, Java, or Scala.
• Hands-on expertise with data lakes, SQL databases, cloud data warehousing, and ETL tools such as Snowflake, Redshift, or BigQuery.
• Deep knowledge of Spark internals, Delta or Iceberg, JVM optimisation, memory management, and AI ecosystems including machine learning, deep learning, and generative AI.
• Experience with AWS, Azure, or GCP, plus CI/CD pipelines, monitoring, and alerting systems.
• 3–5 years in customer-facing roles such as Technical Account Manager or Solutions Architect, with strong communication, problem-solving, collaboration, and leadership skills.

Culture & Benefits

• Work with Field, Engineering, R&D, NOC, Sales, Product, and customer teams.
• Participate in customer engagements, technical presentations, and business review meetings as a trusted technical advisor.
• Access comprehensive employee benefits and perks, with details varying by region.
• Join a diverse and inclusive workplace committed to equal employment opportunity.