Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Staff Software Engineer (Lakeflow): Building distributed systems for cross-region replication and recovery of Lakeflow streaming and batch pipelines with an accent on consistency, idempotency, failover, and safe recovery. Focus on designing recovery workflows, reconciling metadata and transaction state, and testing complex failure modes without silent data loss or duplication.
Location: Mountain View, California or San Francisco, California, United States
Salary: $192,000–$260,000 USD per year, with potential annual bonus, equity, and benefits.
Company
Databricks is a Data and AI company providing a unified Lakehouse platform for data engineering, analytics, and AI applications.
What you will do
- Design and implement distributed systems for cross-region replication and recovery of Lakeflow pipelines.
- Build recovery capabilities for streaming tables, materialized views, checkpoints, source offsets, state, table versions, schedules, and dataflow dependencies.
- Develop failover and failback workflows with conservative correctness guardrails.
- Improve metadata reconciliation, observability, deep cloning, and failure-injection testing.
- Run high-fidelity recovery simulations and game-day tests while reasoning formally about failure modes.
Requirements
- Strong passion for distributed systems, databases, storage systems, streaming systems, or reliability engineering.
- Strong software engineering skills in Java, Scala, C++, Go, Python, or a similar production language.
- Understanding of consistency, transactions, idempotency, replication, checkpointing, and data lineage.
- Ability to define a multi-year technical vision and deliver incremental, production-quality solutions.
- 8+ years of experience working on related systems preferred.
Nice to have
- PhD or advanced research experience in databases, distributed systems, or storage.
Culture & Benefits
- Opportunity to build resilient Lakehouse computing foundations for business-critical data pipelines.
- Comprehensive employee benefits and perks, varying by region.
- Inclusive workplace with equal employment opportunity practices.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
Airbnb
3 дня назад
Staff Software Engineer (Data Infrastructure)
212 000 - 265 000$
6 дней назад
Staff Data Engineer (AI)
202 500 - 274 000$
6 дней назад
Data Operations Engineer
137 510 - 195 000$
9 дней назад
Staff Software Engineer (Data Engineering)
202 500 - 274 000$
3 дня назад
Data Engineer (Databricks)
125 000 - 159 000$
4 дня назад
Software Engineer 3 (Data Analytics)
86 - 136$