Назад
Company hidden
7 дней назад

Senior Data Engineer (Web3)

Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Data Engineer (Web3): Design and operate high-throughput data pipelines and platform systems for blockchain data across 30+ chains with an accent on Go and Python services, ClickHouse analytical workloads, and incremental Databricks processing. Focus on tuning sub-second queries, scaling pipelines across billions of rows and tens of terabytes, and solving complex performance, reliability, and cost-efficiency problems.

Location: Remote, New York

Company

hirify.global provides blockchain transaction monitoring and intelligence solutions for Web3 companies, digital asset service providers, financial institutions, law enforcement, and government agencies.

What you will do

  • Design and build scalable, high-throughput data pipelines and platform systems for blockchain data across 30+ chains.
  • Build backend data services and loaders in Go and Python.
  • Design data models and analytical workloads in ClickHouse, including schema design, materialized views, bulk loads, and query tuning.
  • Build incremental and idempotent Databricks pipelines over billions of rows and tens of terabytes.
  • Improve platform scale, reliability, freshness, performance, and cost efficiency; investigate and resolve difficult performance and reliability issues.
  • Collaborate with product, analytics, and investigations teams, contribute to architecture and code reviews, and mentor engineers.

Requirements

  • 5+ years building and operating production data systems, including ETL and ELT pipelines, with at least 2 years owning systems used by other engineers.
  • Expert Python and strong SQL, including typed and tested code, asyncio, concurrency, and incremental data models over billions of rows.
  • Production experience building and operating high-throughput services or data loaders in Go.
  • Production ClickHouse experience, including MergeTree schema and sort-key design, materialized views, bulk loads, and query tuning.
  • Production Databricks experience with PySpark, Delta Lake, Unity Catalog, incremental and idempotent tables, and compute-cost management.
  • Hands-on experience with pipelines over billions of rows and tens of terabytes, including partitioning, clustering, and file sizing for cost and latency.
  • Production experience with Kafka, Airflow, Kubernetes, Docker, and Helm; understanding of delivery semantics, idempotent writes, backfills, and failure handling. Google Cloud is preferred; AWS is acceptable.
  • Ability to instrument systems, write runbooks and post-incident reviews, and prepare design documents for review across time zones.

Nice to have

  • Blockchain data experience with EVM, UTXO, or non-EVM chain models and node data retrieval via JSON-RPC or gRPC.
  • Graph or distributed key-value stores for entity resolution or clustering on large graphs.
  • Infrastructure as code, GitOps, observability, Terraform, Helm, ArgoCD, OpenTelemetry, Prometheus, Grafana, and load-test design.
  • Experience building platforms serving multiple data sources, datasets, or product teams.
  • AI-assisted development or experience in fintech, compliance, or AML.

Culture & Benefits

  • Small, senior team with end-to-end ownership and evidence-based decision-making.
  • Design notes and runbooks are maintained alongside the code; production-scale testing and blameless post-incident reviews are standard.
  • AI coding tools are used daily, with human judgment applied during review.
  • Full-time employment with health insurance, flexible time off, learning and development initiatives, and work-life balance-oriented hours.
  • Team-building sessions, mental health discussions, competitive compensation, and equity.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →