Назад
2 дня назад

Staff Software Engineer (Lakeflow)

192 000 - 260 000$
Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Staff Software Engineer (Lakeflow): Building distributed systems for cross-region replication and recovery of Lakeflow streaming and batch pipelines with an accent on consistency, idempotency, failover, and safe recovery. Focus on designing recovery workflows, reconciling metadata and transaction state, and testing complex failure modes without silent data loss or duplication.

Location: Mountain View, California or San Francisco, California, United States

Salary: $192,000–$260,000 USD per year, with potential annual bonus, equity, and benefits.

Company

Databricks is a Data and AI company providing a unified Lakehouse platform for data engineering, analytics, and AI applications.

What you will do

  • Design and implement distributed systems for cross-region replication and recovery of Lakeflow pipelines.
  • Build recovery capabilities for streaming tables, materialized views, checkpoints, source offsets, state, table versions, schedules, and dataflow dependencies.
  • Develop failover and failback workflows with conservative correctness guardrails.
  • Improve metadata reconciliation, observability, deep cloning, and failure-injection testing.
  • Run high-fidelity recovery simulations and game-day tests while reasoning formally about failure modes.

Requirements

  • Strong passion for distributed systems, databases, storage systems, streaming systems, or reliability engineering.
  • Strong software engineering skills in Java, Scala, C++, Go, Python, or a similar production language.
  • Understanding of consistency, transactions, idempotency, replication, checkpointing, and data lineage.
  • Ability to define a multi-year technical vision and deliver incremental, production-quality solutions.
  • 8+ years of experience working on related systems preferred.

Nice to have

  • PhD or advanced research experience in databases, distributed systems, or storage.

Culture & Benefits

  • Opportunity to build resilient Lakehouse computing foundations for business-critical data pipelines.
  • Comprehensive employee benefits and perks, varying by region.
  • Inclusive workplace with equal employment opportunity practices.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →