Senior Data Platform Engineer (AI)

TL;DR

Senior Data Platform Engineer (Python/Spark): Designing and building greenfield cloud-native data platforms, real-time pipelines, and data products for clients with an accent on modern architectural patterns like data mesh and data contracts. Focus on processing and transforming large datasets using Spark and Flink, and implementing secure, compliant data solutions.

Location: Hybrid in Sydney, Australia

Company

hirify.global is a global technology consultancy operating across London, Poland, Sydney, San Francisco, and New Zealand, specializing in data engineering, AI, and software engineering.

What you will do

• Design and deliver cloud-native data platforms using Databricks, Snowflake, AWS, and GCP.
• Apply modern architectural patterns such as data mesh, data products, and data contracts.
• Build and optimise batch and real-time pipelines with Kafka, Flink, Kinesis, and Pub/Sub.
• Orchestrate workflows using Airflow, Dataflow, and Glue.
• Process and transform large datasets using Spark and Flink.
• Implement secure, compliant data solutions and embed governance.
• Work directly with clients to understand problems and shape solutions.

Requirements

• Strong Python and SQL skills.
• Deep experience with Spark and modern data platforms (Databricks / Snowflake).
• Solid grasp of cloud data services (AWS or GCP).
• Built and operated large-scale data pipelines in production.
• Strong data modelling capability and architectural judgment.
• Infrastructure-as-code experience (Terraform, Pulumi) and CI/CD pipelines.

Nice to have

• JVM or systems languages (Scala, Java, Go, Rust).
• Experience in consulting or professional services.

Culture & Benefits

• Work on interesting, high-impact problems and build modern platforms.
• Opportunity to work alongside senior engineers.
• Autonomy, influence, and room for professional growth.