Senior Data Engineer (GCP)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (GCP): Designing and scaling a modern data lakehouse for next-generation analytics at petabyte scale with an accent on distributed query engines and secure data governance. Focus on optimizing query performance, implementing open table formats, and orchestrating robust ETL/ELT pipelines.
Location: Remote (Must be based in North America)
Salary: $190,000 - $220,000
Company
provides AI-powered intelligence solutions to help public and private sector agencies investigate and disrupt financial crime in the crypto space.
What you will do
- Architect and scale a high-performance data lakehouse on GCP using StarRocks, Iceberg, GCS, and BigQuery.
- Optimize distributed query engines such as Trino, Spark, or Snowflake to support complex analytical workloads.
- Implement metadata management and data discovery frameworks for governance and observability.
- Develop and orchestrate robust ETL/ELT pipelines using Apache Airflow, Spark, and GCP-native tools.
- Collaborate with data scientists and backend engineers to design and implement foundational data infrastructure.
Requirements
- 5+ years of experience in data or software engineering, focusing on distributed data systems and cloud-native architectures.
- Proven experience building and scaling data platforms on GCP.
- Strong command of query engines such as Trino, Presto, Spark, or Snowflake.
- Experience with modern table formats like Apache Hudi, Iceberg, or Delta Lake.
- Expert programming skills in Python and proficiency in SQL or SparkSQL.
- Must be based in North America.
Culture & Benefits
- Remote-first and async-friendly environment.
- High-ownership culture with a focus on rapid iteration and the "80/20 principle".
- Equity plan eligibility.
- Strict limit on meetings to ensure deep work (target 3-4 hours/week for ICs).
- Work at the intersection of AI, national security, and financial crime fighting.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →