14 часов назад
Distinguished Engineer (Data Engineering)
275 000 - 330 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Distinguished Engineer (Data Engineering): Designing and scaling CloudZero’s next-generation streaming data platform, dimensional cost model, hot/cold storage architecture, query engine, and real-time cost attribution with an accent on high-cardinality data, streaming reliability, and production-scale platform architecture. Focus on building fault-tolerant pipelines, optimizing distributed query execution, driving batch-to-streaming migrations, and establishing SLOs and correctness guarantees across multi-tenant workloads.
Location: Hybrid in San Francisco or Boston, Massachusetts, United States
Salary: $275,000–$330,000 per year, plus equity and bonus
Company
provides an AI ROI and cloud cost management platform that connects infrastructure and AI spending to business outcomes in real time.
What you will do
- Define the end-to-end architecture for the next-generation data platform, covering ingestion, stream processing, enrichment, storage, query services, and APIs.
- Design and operate real-time streaming infrastructure capable of processing production workloads across thousands of customers.
- Establish throughput, latency, and correctness SLOs and create operational playbooks for replacing batch pipelines.
- Redesign the dimensional cost model and incremental materialization strategies to support high-cardinality, multi-dimensional attribution.
- Lead query engine evolution, migrations, performance optimization, and scaling across partition pruning, predicate pushdown, and query planning.
- Set the data engineering roadmap, align cross-functional stakeholders, and mentor senior and staff engineers.
Requirements
- 10+ years of data engineering experience with progression toward principal- or staff-level architecture.
- Experience building and operating large-scale data platforms processing tens of millions of events per day.
- Deep production experience with streaming systems such as Kafka, Kinesis, Flink, or Spark Streaming.
- Strong experience with Apache Iceberg, Delta Lake, or Hudi, including compaction, partitioning, and time-travel queries.
- Expertise in dimensional modeling, cardinality management, materialization strategies, multi-tenant partitioning, SQL, and query optimization.
- Hands-on experience with distributed query engines, cloud data warehouses, catalog and metadata management, and production migrations.
Nice to have
- FinOps or cloud cost management experience.
- Multi-cloud ingestion across AWS, Azure, and GCP.
- Production-scale Apache Flink, lakehouse architecture, real-time ML feature engineering, or data mesh experience.
- Startup or high-growth SaaS experience and open-source contributions to the data ecosystem.
Culture & Benefits
- Collaborative, fast-moving environment with high ownership and autonomy.
- Direct impact on a platform used by major cloud spenders and processing large-scale billing data.
- Opportunity to work with AI, streaming, lakehouse, and cloud cost technologies.
- Equity and performance bonus are offered in addition to salary.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
5 дней назад
Senior Data Engineer
241 000 - 255 000$
5 дней назад
Data Platform Engineer (AI, Lakehouse)
Ramp
6 дней назад
Data Scientist (Fintech)
137 120 - 297 330$
6 дней назад
Cloud Data Engineer (Databricks)
175 000 - 200 000$
7 часов назад
Senior Data Scientist (AI/ML)
124 000 - 329 200$
3 дня назад
Data Scientist (AI)
160 000 - 245 000$