6 дней назад
Senior Data Engineer (Web3)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Engineer (Web3): Building and maintaining batch and streaming data pipelines and data models for a crypto exchange with an accent on Python, SQL, Kafka, Spark, and Airflow. Focus on improving data quality and freshness, optimizing pipeline and query performance, and designing dependable datasets for analytics and reporting.
Location: Fully remote within APAC
Company
is a global centralized crypto trading platform offering spot and perpetual futures trading, with a focus on liquidity, execution quality, transparency, and reliable trading tools.
What you will do
- Build and maintain batch and streaming data pipelines with Python, SQL, Kafka, and Spark.
- Develop and operate Airflow workflows, including scheduling, dependencies, retries, and recovery.
- Design and maintain data models and warehouse datasets for analytics and reporting.
- Improve data quality and freshness through validation, monitoring, and investigation of upstream and downstream issues.
- Optimize pipeline and query performance while managing processing and storage costs.
- Define datasets and metrics with data users and document data flows, transformations, and dependencies.
Requirements
- Data engineering experience in crypto or Web3, including ownership of production pipelines or a data platform.
- Strong Python and SQL skills with experience building maintainable data processing workflows.
- Hands-on experience with Airflow, Kafka, and Spark.
- Experience with data warehouses, ETL/ELT pipelines, and data modelling.
- Ability to investigate data discrepancies, troubleshoot pipeline failures, and resolve underlying causes.
- Ability to communicate technical details and business requirements clearly in Mandarin.
Nice to have
- Experience at a centralized crypto exchange, especially with trading, order, or account data.
- BI experience supporting dashboards, defining metrics, or preparing datasets for business users.
- Strong English communication skills.
Culture & Benefits
- Fully remote work within APAC.
- Mandarin is the team’s main working language.
- Hands-on individual contributor role focused on platform engineering.
- Work on a data platform connected to the daily operations of a crypto exchange.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →