Senior Data Engineer (Databricks)

TL;DR

Senior Data Engineer (Databricks): Building and scaling a modern data platform to power analytics and data science with an accent on lakehouse architecture and high-performance pipeline development. Focus on designing reliable batch and real-time ingestion workflows, implementing data governance, and optimizing production systems for media-specific datasets.

Location: Must be based in or able to commute to North Hollywood, CA (Hybrid: 3 days/week in office)

Salary: $140,000 - $160,000

Company

hirify.global is a major media and entertainment corporation operating iconic brands across news, sports, and entertainment sectors.

What you will do

• Design and implement lakehouse architecture using Delta Lake and medallion pipeline patterns.
• Build and operate batch and real-time ingestion pipelines using Databricks and Spark.
• Implement data governance and security frameworks using Unity Catalog.
• Optimize system performance and manage costs through FinOps strategies and Spark tuning.
• Maintain CI/CD pipelines and orchestration workflows using tools like Airflow.
• Collaborate with Data Science teams on ML workflows and model lifecycle management.

Requirements

• Must be able to work from the North Hollywood office 3 days per week.
• 5+ years of experience building production-grade data pipelines in cloud environments.
• Expertise in PySpark, SQL, and distributed processing frameworks like Spark or Flink.
• Proficiency with orchestration tools such as Apache Airflow or Dagster.
• Strong understanding of infrastructure, networking, and data security fundamentals.
• Experience with Git and collaborative development workflows.

Nice to have

• Experience with Databricks, Unity Catalog, and Lakeflow.
• Background in media and entertainment data analytics.
• Familiarity with MLOps practices and feature store integration.
• Databricks or cloud certifications.

Culture & Benefits

• Comprehensive health benefits including medical, dental, and vision insurance.
• 401(k) retirement plan with company sponsorship.
• Paid leave and tuition reimbursement programs.
• Opportunity to work with large-scale media datasets and innovative brands.