Lead Data Engineer (Apache Spark/Flink)

TL;DR

Lead Data Engineer (Apache Spark/Flink): Designing and building high-throughput data pipelines for the hirify.globalX experimentation platform with an accent on automated analysis engines and real-time configuration management. Focus on scaling data processing to billions of events daily, implementing Metric Store models, and ensuring high-fidelity data for A/B testing.

Location: Onsite at the hirify.global Vietnam office (District 7, HCMC)

Company

hirify.global is Southeast Asia's leading superapp providing delivery, financial, and transportation services.

What you will do

• Design and build batch and real-time data pipelines processing billions of daily events for automated analysis.
• Develop efficient Spark and Flink jobs to calculate complex business metrics and statistical significance at scale.
• Implement data validation and monitoring frameworks to ensure experiment results are accurate and trustworthy.
• Lead the transition of the data architecture toward a centralized Metric Store model.
• Mentor a team of engineers while driving best practices in data modeling and system design.
• Collaborate with Data Scientists to automate hypothesis testing and anomaly detection.

Requirements

• Minimum of 7+ years of experience in Data Engineering or Software Engineering with a focus on data-heavy systems.
• Expert-level proficiency in Scala, Go, or Python.
• Extensive experience building large-scale data processing systems using Apache Spark or Apache Flink.
• Strong understanding of OLAP database technologies such as StarRocks, ClickHouse, or Trino.
• Proven track record of leading engineering teams in high-load, low-latency environments.
• English: Strong communication skills required for regional or global environments.

Nice to have

• Experience building internal experimentation platforms or automated A/B testing frameworks.
• Proficiency in CI/CD tools, AWS, Terraform, and Kubernetes for data infrastructure.
• Familiarity with statistical concepts used in experimentation such as p-values and confidence intervals.

Culture & Benefits

• Comprehensive medical and term life insurance.
• hirify.globalFlex customizable benefits package.
• Parental, Birthday, and volunteering (LASA) leave.
• hirify.globalber Assistance Programme for personal and family support.
• FlexWork arrangements to better balance personal commitments.