Staff Data Platform Engineer (AI)

TL;DR

Staff Data Platform Engineer (AI): Leading the design and delivery of a mission-critical Data Transfer Hub to ingest petabytes of sensor data for autonomous driving models with an accent on reliability, throughput, and global scalability. Focus on building parallelized, distributed pipelines using Python, Terraform, and Azure to enable large-scale AI model training.

Location: Must be based in London, UK (Hybrid role).

Company

hirify.global is a leading developer of Embodied AI technology, building mapless and hardware-agnostic software to accelerate the transition to automated driving.

What you will do

• Set technical direction for the Data Transfer Hub, balancing reliability, throughput, and cost.
• Lead the technical design and delivery of ingestion systems for video, LiDAR, and sensor data at PB/day scale.
• Build parallelized, distributed data transfer pipelines using Flyte, Kafka, and Azure.
• Develop and operate a globally distributed hub-and-spoke data transfer model.
• Write infrastructure-as-code using Terraform and pipeline logic in Python.
• Implement cloud-to-cloud and cross-cloud networking solutions.

Requirements

• Must be based in London, UK and able to work in a hybrid capacity.
• Proven experience building large-scale data transfer pipelines at multi-TB or PB scale.
• Strong proficiency in Python and Terraform.
• Experience with workflow orchestration tools like Flyte, Airflow, or Prefect.
• Strong cloud platform skills, with a preference for Azure.
• Experience with cloud-to-cloud networking and large-scale object storage.

Nice to have

• Experience with Kafka for event-driven observability.
• Multi-cloud experience across AWS or GCP.
• Background in autonomous vehicles, robotics, or similar data-intensive domains.
• Experience working directly with external data partners.

Culture & Benefits

• Hybrid working policy balancing office collaboration with remote flexibility.
• Core working hours to support individual schedule management.
• Opportunity to work on cutting-edge Embodied AI technology.
• Direct impact on commercial deployments with major automotive partners.
• Inclusive and diverse work environment.