Senior Simulation Data Engineer

TL;DR

Senior Simulation Data Engineer: Extend and operate infrastructure powering the research Data Factory, orchestrating thousands of CFD simulations and building end-to-end data pipelines for ML training with an accent on simulation orchestration, data quality validation, and high-performance processing. Focus on designing job scheduling systems, implementing validation checks, and optimizing I/O for large-scale HPC workflows.

Location: London, United Kingdom (Hybrid setup – Shoreditch office with remote flexibility)

Company

Deep-tech company with roots in numerical physics and Formula One, building AI-driven simulation software stack for engineering and manufacturing in Aerospace & Defense, Materials, Energy, Semiconductors, and Automotive.

What you will do

• Extend and operate Data Factory infrastructure to orchestrate thousands of CFD simulations daily on cloud compute.
• Design job scheduling, monitoring, and alerting systems to maximize throughput and handle failures.
• Build high-performance data pipelines for geometry preprocessing, post-processing, and delivery to ML training systems.
• Implement validation checks at every stage to ensure data quality, quarantine bad data, and track metrics.
• Design data versioning, cataloging, and integration for reproducible ML training workflows.
• Collaborate with Research Scientists, ML Engineers, and ML Infrastructure Engineers on data requirements and handoffs.

Requirements

• 5+ years in data engineering, HPC engineering, or simulation infrastructure.
• Strong experience with orchestration: SLURM, Kubernetes, Temporal.
• Production data pipeline experience processing large volumes reliably.
• Proficiency in Python; systems engineering: Linux, networking, storage, performance debugging.
• Cloud infrastructure experience, ideally CoreWeave or GPU/HPC clouds.
• Background in HPC simulations: CFD, FEA (StarCCM+, OpenFOAM, ANSYS); geometry processing (PyVista); scientific formats (HDF5, VTK, NetCDF, Zarr).
• Data quality engineering: validation, anomaly detection.

Nice to have

• Understanding of CFD fundamentals.
• Experience with 3D geometry pipelines (mesh decimation, field interpolation).
• Familiarity with ML data loading patterns.

Culture & Benefits

• Equity options and 10% employer pension contribution.
• Free office lunches, flexible working, hybrid setup.
• Enhanced parental leave, private healthcare, personal development resources.
• Work from anywhere for extended remote periods.
• Commitment to diversity, equal opportunity, and supporting underrepresented groups.