Staff/Senior Staff Web3 Big Data Engineer (Web3)

TL;DR

Staff/Senior Staff Web3 Big Data Engineer (Web3/AI): Designing and optimizing a high-scale big data platform for on-chain data and trading behavior with an accent on real-time pipelines, data lake architecture, and AI-driven applications. Focus on integrating LLM capabilities for fraud detection, building vector database infrastructure for RAG, and ensuring system reliability for global crypto operations.

Location: Hong Kong or Singapore

Company

OKX is a leading crypto exchange and developer of the OKX Wallet, providing millions of users and institutions with access to crypto trading and decentralized applications.

What you will do

• Own the architecture and optimization of the big data platform for large-scale collection and analysis of on-chain and trading data.
• Design and build real-time and batch data pipelines for blockchain transactions and smart contract events.
• Maintain the data warehouse/lake and define data-layering standards to ensure quality and timeliness.
• Develop AI-driven applications using LLMs for on-chain anomaly detection and natural-language querying (Text2SQL).
• Build AI infrastructure, including vector databases and Embedding pipelines to support RAG retrieval.
• Collaborate with AI, Product, and Risk teams to develop feature engineering pipelines for model training.

Requirements

• 7+ years of big data development experience with a degree in Computer Science or a related field.
• Proficiency in Hadoop, Spark, and Flink, with experience in Hive, Kafka, HBase, ClickHouse, and Doris.
• Strong development skills in Java, Scala, or Python and expert-level SQL tuning ability.
• Understanding of LLM fundamentals, prompt engineering, RAG, and experience with vector databases.
• Knowledge of blockchain fundamentals (UTXO, consensus) and on-chain data structures for major public chains.
• Fluent English proficiency for technical documentation and global collaboration.

Nice to have

• Basic knowledge of Solidity and ability to read smart contract code.
• Contributions to open-source big data, blockchain, or AI infrastructure projects.
• AWS/GCP certifications in big data or AI.
• Experience using AI coding agents (e.g., Claude Code) to improve engineering efficiency.

Culture & Benefits

• Competitive total compensation package.
• Comprehensive insurance coverage for employees and their dependants.
• A rewarding and diverse environment focused on core principles like "We Before Me".