9 дней назад
Senior Data Architect (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Architect (Databricks): Designing and governing Databricks Lakehouse platforms for production-grade data delivery with an accent on Unity Catalog, Microsoft Purview, CI/CD, and Azure environment architecture. Focus on defining governed ingestion patterns, migrating from Azure Data Factory, separating dev/test/prod environments, and resolving complex platform and security decisions through client handover.
Location: Hybrid across major Australian locations, including Sydney, Canberra, Melbourne, Brisbane, and Perth; occasional travel to client sites may be required.
Company
is an ASX-listed Australian advisory and IT solutions company with a Data & Integration business unit focused on data platforms, system integration, and digital transformation.
What you will do
- Lead the technical uplift of Databricks Lakehouse platforms and define governed, automated, production-grade data delivery foundations.
- Design Unity Catalog metastore and catalog structures, workspace binding, access controls, and Microsoft Purview classification and PII handling.
- Define CI/CD and dev/test/prod environment architectures using Azure DevOps and Databricks Asset Bundles.
- Design Lakeflow Declarative Pipelines ingestion patterns and migration paths from Azure Data Factory.
- Provide technical governance by reviewing deliverables for CI/CD automation, Purview deployment, Unity Catalog, source scanning, and cluster log streaming.
- Facilitate architecture workshops, obtain client sign-off, and contribute to presales, scoping, estimation, and solution design.
Requirements
- At least 5 years of data platform experience, including at least 2 years in a hands-on Databricks architecture role.
- Current Databricks certification, such as Databricks Certified Data Engineer Professional or Associate Developer for Apache Spark.
- Hands-on experience with Unity Catalog, CI/CD using Azure DevOps and Databricks Asset Bundles, and dev/test/prod separation.
- Experience with Infrastructure as Code for Azure data platforms, using tools such as Terraform, ARM templates, or Bicep.
- Experience designing Microsoft Purview governance, including classification, PII controls, lineage scanning, and source registration.
- Experience with Lakeflow Declarative Pipelines or Delta Live Tables, Azure Data Factory migration, medallion architecture, stakeholder workshops, and architecture documentation.
Nice to have
- Experience remediating Azure data security issues, including Blob Storage access controls and Synapse Link or CDC configurations.
- Familiarity with Coalesce, Databricks cost management, and cluster policy design.
- Experience with membership-based or not-for-profit organisations and complex data residency or PII obligations.
- Presales and scoping experience, including effort estimation and technical proposal writing.
Culture & Benefits
- Permanent full-time or contract engagement options.
- Career growth through succession planning, internal promotions, mentorship, and professional certifications.
- Employee benefits, recognition, wellbeing support, and an Employee Assistance Program.
- Paid parental leave and support for family and caring responsibilities.
- Collaborative culture focused on innovation, continuous learning, respect, and inclusion.
Hiring process
- Applications must be submitted online through the careers page.
- The recruitment process may also be used to create a talent pool for similar opportunities during the following 12 months.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →