1 день назад
Principal Data Platforms Engineer (Data Engineering)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Principal Data Platforms Engineer (Data Engineering): Design and build cloud-native data platforms, real-time pipelines, and data products with an accent on data mesh, data contracts, scalable architectures, and production-grade engineering. Focus on processing large datasets with Spark and Flink, optimizing storage and performance, embedding security and governance, and guiding clients toward pragmatic technical outcomes.
Location: Sydney, New South Wales, Australia; hybrid workplace
Company
is a global technology consultancy building modern data platforms, intelligent systems, and bespoke software for enterprises, scale-ups, and government clients.
What you will do
- Own the end-to-end architecture and technical direction of modern, cloud-native data platforms.
- Design and deliver greenfield data platforms, data products, data mesh architectures, and data contracts using Databricks, Snowflake, AWS, and GCP.
- Build and optimize batch, real-time, streaming, and event-driven pipelines with Kafka, Flink, Kinesis, Pub/Sub, Airflow, Dataflow, and Glue.
- Process large datasets with Spark and Flink while optimizing storage, access patterns, and production performance.
- Implement secure, compliant, governed, and observable data solutions.
- Advise clients, set engineering standards, review designs and code, and mentor senior engineers.
Requirements
- Strong Python and SQL skills with deep experience in Spark and modern data platforms such as Databricks and Snowflake.
- Solid experience with AWS or GCP cloud data services and large-scale production data pipelines.
- Demonstrated ownership of data platform architecture, data modeling, and high-impact technical decisions.
- Experience with relational, NoSQL, and analytical storage technologies and formats.
- Infrastructure-as-code experience with Terraform or Pulumi, plus CI/CD using tools such as GitHub Actions or ArgoCD.
- Experience with data testing and quality frameworks such as dbt, Great Expectations, or Soda, along with consulting and technical leadership experience.
Culture & Benefits
- Work on interesting, high-impact data and software problems.
- Build modern platforms rather than maintaining legacy systems.
- Collaborate with highly experienced senior engineers.
- Receive autonomy, influence, and opportunities for professional growth.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
2 дня назад
Senior Software Engineer (Data Platform)
220 000 - 265 000$
10 часов назад
Principal Data Engineer (AWS)
151 800 - 220 050$
2 дня назад
Software Engineer - Data (Python/AWS)
135 000 - 180 000$
2 дня назад
Principal Data Engineer (Fintech)
2 дня назад
Senior Data Engineer (Fintech)
2 дня назад