Core Data Engineer (Real-time Analytics)

TL;DR

Core Data Engineer (Real-time Analytics): Developing and owning the end-to-end lifecycle of critical real-time data products for low-latency analytical capabilities with an accent on automated pipelines and OLAP databases. Focus on optimizing data extraction from market data and application logs to drive strategic firm expansion.

Location: Hong Kong

Company

hirify.global is a leading global proprietary trading firm focused on creating liquidity in ETFs.

What you will do

• Own the end-to-end lifecycle of core data products (Market Data, Trades, Logs) with a focus on low-latency analytics.
• Build and maintain automated pipelines, develop quality checks, and systematize manual processing steps.
• Define and manage project plans to assume ownership of vital data products.
• Create and refine a common processing model for fast vs slow data paths.
• Investigate, evaluate, and onboard additional data sources to maximize organizational value.
• Collaborate with cross-functional teams to automate workflows and provide guidance on data architecture and design.

Requirements

• Excellent programming skills in Python.
• Proficiency with Linux, SQL, relational databases, and version control systems.
• Proven experience with real-time OLAP databases like ClickHouse, Apache Pinot, or StarRocks.
• Experience with Airflow, Kafka, and GCP (specifically GKE, Dataproc, and BigQuery).
• Ability to balance individual stakeholder demands while preserving data quality and wide applicability.
• Strong interpersonal skills and the ability to manage multiple parallel projects effectively.

Nice to have

• Experience with Pandas, Spark, Apache Beam, or Apache NiFi.
• Domain expertise in exchange market data, network traffic, security reference/pricing data, or ETF compositions.

Culture & Benefits

• Access to Flow Academy for continuous learning and attendance at domain-related conferences.
• Comprehensive health insurance coverage.
• Daily catered breakfast and lunch with healthy snacks and drinks.
• In-house amenities including a lounge with a bar, games, a hairdresser, and a massage therapist.
• Wellness support through personal trainers, weekly boot camps, and subsidized gym memberships.
• Annual company trip and various team events throughout the year.