3 дня назад
Lead Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Engineer (Databricks): Building analytics foundations and Gold-layer data models through Medallion architecture transformations with an accent on PySpark, Spark SQL, data modeling, and delivery leadership. Focus on implementing complex Databricks transformations, unifying data warehouses, improving pipeline reliability, and coordinating execution across a small contractor team.
Location: New York, NY, United States; remote or in-office flexibility is available.
Company
provides an agentic commerce orchestration engine and intelligent commerce network for enterprise retailers, brands, suppliers, and distributors.
What you will do
- Lead a small delivery team as a hands-on player-coach, reviewing and guiding contractor contributions.
- Own complex data transformations and modeling work across analytics foundations and Gold-layer data models.
- Design and implement Bronze-to-Silver-to-Gold Medallion architecture transformations in Databricks.
- Improve the reliability, clarity, performance, and maintainability of data pipelines and Gold-layer outputs.
- Execute the approved Data Warehouse Unification Plan across multiple Databricks instances.
- Translate engineering specifications into sprint plans and tickets, assign work, review pull requests, and communicate risks and progress.
Requirements
- Strong hands-on experience with Databricks, PySpark, and Spark SQL.
- Proven experience implementing Medallion architecture.
- Solid data modeling skills for analytics and reporting use cases.
- Experience leading delivery for small engineering teams; formal management experience is not required.
- Ability to refine partially defined requirements collaboratively and communicate clearly in a remote environment.
Nice to have
- Experience supporting GDPR-compliant data strategies.
- Exposure to multi-region or multi-tenant data platforms.
- Familiarity with external analytics tools consuming warehouse data.
- Experience with data flows sourced from Azure, AWS, GCP, and other platforms.
Culture & Benefits
- Mission-driven work focused on transforming digital commerce.
- Collaborative, no-ego environment where ideas and shared learning are valued.
- Autonomy and accountability in remote or in-office work settings.
- Accessible leadership invested in employee growth and open to ideas.
- Team offsites and recognition of progress through shared celebrations.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
Data Engineer (Databricks)
4 400 - 5 200€
6 дней назад
Lead Data Engineer (AI/ML)
188 251 - 230 084$
6 дней назад
Data Engineer (Azure/Databricks)
85 000 - 122 200$
3 дня назад
Lead Data Engineer (Kafka)
125 400 - 181 875$
7 дней назад
Senior Data Engineer (Databricks/Azure)
8 дней назад
Lead Machine Learning / Data Science Engineer
90 000 - 200 000$