8 дней назад
Lead Data Engineer (Databricks)
109 500 - 167 833$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Engineer (Databricks): Building and operating consumer-facing data products on an Azure Databricks lakehouse across Raw, Prep, and Prod layers with an accent on dimensional modeling, data contracts, testing, and observability. Focus on setting technical standards, managing breaking changes, tuning production pipelines, and ensuring reliable data products for analytics and ML consumers.
Location: Remote within the United States, listed as Birmingham, Alabama / Nebraska - Virtual / Work From Home
Salary: $109,500–$167,833 per year, plus potential annual incentive
Company
provides insurance and financial protection products designed to help customers manage life’s uncertainties.
What you will do
- Lead end-to-end design and dimensional modeling of data products across Raw, Prep, and Prod lakehouse layers.
- Own ODCS data contracts, including quality rules, freshness expectations, consumer compatibility, and breaking-change communication.
- Set standards for Python, SQL, dbt, testing, repository structure, naming, and CI/CD while reviewing production code.
- Operate and improve pipelines through monitoring, incident response, backfills, performance tuning, cost optimization, and runbook development.
- Partner with product, platform, architecture, governance, DataOps, and MLOps teams on delivery, access, orchestration, and observability.
- Mentor engineers through design reviews, pairing, and code reviews, while improving reusable frameworks and platform adoption.
Requirements
- Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience.
- 6+ years building and operating production data pipelines and consumer-facing data models.
- Strong hands-on Python and SQL skills, with experience making technical design decisions and reviewing code.
- Experience with Databricks or a comparable Spark-based lakehouse, including Delta Lake, MERGE, incremental processing, and performance tuning.
- Deep experience with dimensional modeling, data contracts, production incidents, orchestration, Git, code review, CI/CD, and data observability.
- Ability to communicate trade-offs clearly and provide technical leadership without people-management responsibility.
Nice to have
- Databricks certification, Unity Catalog, dbt at scale, Dagster, Dagster Cloud, or declarative Python ingestion frameworks such as dlt.
- Experience with Great Expectations, Monte Carlo, MLflow, model registries, model serving, Azure, and Azure DevOps.
- Experience with ODCS, data mesh, regulated industries, insurance, financial services, or AI-assisted development.
Culture & Benefits
- Full-time remote work within the stated United States location arrangement.
- Health, dental, and vision insurance, along with mental health benefits and an employee assistance program.
- Paid time off, paid parental leave, short-term disability, and a cultural observance day.
- Healthcare account contributions, a pension plan, and a 401(k) plan with company matching.
- Annual incentive opportunities based on individual and company performance.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
9 дней назад
Lead DataOps Engineer (Azure)
10 833 - 14 667$
14 дней назад
Databricks Data Engineer (Risk Technology)
120 000 - 160 000$
13 дней назад
Lead Data Engineer (Tax)
140 000 - 210 000$
9 дней назад
Principal Data Lead
174 300 - 205 900$
Peraton
9 дней назад
Senior Data Engineer (Databricks, Security & Governance)
112 000 - 179 000$
9 дней назад
Data Architect (Cloud Data)
138 000 - 200 100$