Senior Data Engineer (Databricks)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (Databricks): Designing and scaling a modern data platform to power analytics and data science across media brands with an accent on lakehouse architecture and high-performance pipelines. Focus on building reliable batch and real-time ingestion systems, implementing data governance, and optimizing production workflows using Spark and Databricks.
Location: Must be based in or able to commute to North Hollywood, CA (Hybrid: 3 days/week in office)
Salary: $140,000 - $160,000
Company
is a leading media and entertainment company operating iconic brands across news, sports, and entertainment sectors.
What you will do
- Design and implement lakehouse architecture using Delta Lake and medallion pipeline patterns.
- Build and operate batch and real-time ingestion pipelines using Databricks and Spark.
- Implement data governance and security frameworks using Unity Catalog.
- Optimize platform performance and manage costs through FinOps strategies.
- Develop and maintain CI/CD pipelines and orchestration workflows with Airflow.
- Collaborate with Data Science teams to support ML workflows and model lifecycle management.
Requirements
- 5+ years of experience building production-grade data pipelines in cloud environments.
- Expertise in PySpark, SQL, and distributed processing frameworks.
- Hands-on experience with orchestration tools like Apache Airflow or Dagster.
- Proficiency in CI/CD, monitoring, and data quality practices for production systems.
- Strong understanding of infrastructure, networking, and data security fundamentals.
- Must be able to work in a hybrid capacity from the North Hollywood office.
Nice to have
- Experience with Databricks Unity Catalog and compliance frameworks.
- Background in media and entertainment data analytics.
- Familiarity with MLOps practices and feature store integration.
- Databricks or cloud certifications.
Culture & Benefits
- Comprehensive health benefits including medical, dental, and vision insurance.
- Retirement savings plan with 401(k).
- Paid leave and tuition reimbursement programs.
- Opportunity to work with large-scale media datasets and innovative technologies.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →