pythonsqlgokuberneteskafkaclickhouseairflowdatabrickspysparkdelta lake
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
ЗП не указанаразвернуть
На похожих ролях по рынку
$160к$170кмедиана$205к
50 в выборке
На СНГ рынке: $3.7к/мес ($3к - $4.3к)
88
Крутая вакансия
развернуть
Роль чётко охватывает senior-задачи в data engineering, современный production-стек и ответственность за эксплуатацию; при этом специализация на Web3 добавляет отраслевой риск.
Рискованный домен
Современный стек
Ответственность за результат
Поддержка развития
Акцент на балансе
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Senior Data Engineer (Web3): Design and operate high-throughput data pipelines and platform systems for blockchain data across 30+ chains with an accent on Go and Python services, ClickHouse analytical workloads, and incremental Databricks processing. Focus on tuning sub-second queries, scaling pipelines across billions of rows and tens of terabytes, and solving complex performance, reliability, and cost-efficiency problems.
Location: Remote, New York
Company
hirify.global provides blockchain transaction monitoring and intelligence solutions for Web3 companies, digital asset service providers, financial institutions, law enforcement, and government agencies.
What you will do
Design and build scalable, high-throughput data pipelines and platform systems for blockchain data across 30+ chains.
Build backend data services and loaders in Go and Python.
Design data models and analytical workloads in ClickHouse, including schema design, materialized views, bulk loads, and query tuning.
Build incremental and idempotent Databricks pipelines over billions of rows and tens of terabytes.
Improve platform scale, reliability, freshness, performance, and cost efficiency; investigate and resolve difficult performance and reliability issues.
Collaborate with product, analytics, and investigations teams, contribute to architecture and code reviews, and mentor engineers.
Requirements
5+ years building and operating production data systems, including ETL and ELT pipelines, with at least 2 years owning systems used by other engineers.
Expert Python and strong SQL, including typed and tested code, asyncio, concurrency, and incremental data models over billions of rows.
Production experience building and operating high-throughput services or data loaders in Go.
Production ClickHouse experience, including MergeTree schema and sort-key design, materialized views, bulk loads, and query tuning.
Production Databricks experience with PySpark, Delta Lake, Unity Catalog, incremental and idempotent tables, and compute-cost management.
Hands-on experience with pipelines over billions of rows and tens of terabytes, including partitioning, clustering, and file sizing for cost and latency.
Production experience with Kafka, Airflow, Kubernetes, Docker, and Helm; understanding of delivery semantics, idempotent writes, backfills, and failure handling. Google Cloud is preferred; AWS is acceptable.
Ability to instrument systems, write runbooks and post-incident reviews, and prepare design documents for review across time zones.
Nice to have
Blockchain data experience with EVM, UTXO, or non-EVM chain models and node data retrieval via JSON-RPC or gRPC.
Graph or distributed key-value stores for entity resolution or clustering on large graphs.
Infrastructure as code, GitOps, observability, Terraform, Helm, ArgoCD, OpenTelemetry, Prometheus, Grafana, and load-test design.
Experience building platforms serving multiple data sources, datasets, or product teams.
AI-assisted development or experience in fintech, compliance, or AML.
Culture & Benefits
Small, senior team with end-to-end ownership and evidence-based decision-making.
Design notes and runbooks are maintained alongside the code; production-scale testing and blameless post-incident reviews are standard.
AI coding tools are used daily, with human judgment applied during review.
Full-time employment with health insurance, flexible time off, learning and development initiatives, and work-life balance-oriented hours.
Team-building sessions, mental health discussions, competitive compensation, and equity.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →