Назад
Company hidden
8 дней назад

Lead Data Engineer (Databricks)

109 500 - 167 833$
Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
lead
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Lead Data Engineer (Databricks): Building and operating consumer-facing data products on an Azure Databricks lakehouse across Raw, Prep, and Prod layers with an accent on dimensional modeling, data contracts, testing, and observability. Focus on setting technical standards, managing breaking changes, tuning production pipelines, and ensuring reliable data products for analytics and ML consumers.

Location: Remote within the United States, listed as Birmingham, Alabama / Nebraska - Virtual / Work From Home

Salary: $109,500–$167,833 per year, plus potential annual incentive

Company

hirify.global provides insurance and financial protection products designed to help customers manage life’s uncertainties.

What you will do

  • Lead end-to-end design and dimensional modeling of data products across Raw, Prep, and Prod lakehouse layers.
  • Own ODCS data contracts, including quality rules, freshness expectations, consumer compatibility, and breaking-change communication.
  • Set standards for Python, SQL, dbt, testing, repository structure, naming, and CI/CD while reviewing production code.
  • Operate and improve pipelines through monitoring, incident response, backfills, performance tuning, cost optimization, and runbook development.
  • Partner with product, platform, architecture, governance, DataOps, and MLOps teams on delivery, access, orchestration, and observability.
  • Mentor engineers through design reviews, pairing, and code reviews, while improving reusable frameworks and platform adoption.

Requirements

  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience.
  • 6+ years building and operating production data pipelines and consumer-facing data models.
  • Strong hands-on Python and SQL skills, with experience making technical design decisions and reviewing code.
  • Experience with Databricks or a comparable Spark-based lakehouse, including Delta Lake, MERGE, incremental processing, and performance tuning.
  • Deep experience with dimensional modeling, data contracts, production incidents, orchestration, Git, code review, CI/CD, and data observability.
  • Ability to communicate trade-offs clearly and provide technical leadership without people-management responsibility.

Nice to have

  • Databricks certification, Unity Catalog, dbt at scale, Dagster, Dagster Cloud, or declarative Python ingestion frameworks such as dlt.
  • Experience with Great Expectations, Monte Carlo, MLflow, model registries, model serving, Azure, and Azure DevOps.
  • Experience with ODCS, data mesh, regulated industries, insurance, financial services, or AI-assisted development.

Culture & Benefits

  • Full-time remote work within the stated United States location arrangement.
  • Health, dental, and vision insurance, along with mental health benefits and an employee assistance program.
  • Paid time off, paid parental leave, short-term disability, and a cultural observance day.
  • Healthcare account contributions, a pension plan, and a 401(k) plan with company matching.
  • Annual incentive opportunities based on individual and company performance.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →