Senior Data Engineer (Databricks)

TL;DR

Senior Data Engineer (Databricks): Building and operating scalable batch and real-time data ingestion pipelines with an accent on lakehouse architecture and data governance. Focus on implementing CI/CD workflows, optimizing Spark performance, and collaborating on ML model lifecycles.

Location: Must be based in North Hollywood, CA, United States

Salary: $140,000–$160,000

What you will do

• Build and operate batch and real-time ingestion pipelines.
• Design and implement lakehouse architecture using Delta Lake.
• Collaborate on ML workflows and model lifecycle management.
• Create CI/CD pipelines and orchestration workflows.
• Ensure data quality, observability, and lineage.
• Implement data governance, security, and Spark performance optimization.

Requirements

• Proven experience as a Senior Data Engineer.
• Expertise in Databricks, Delta Lake, and Apache Spark.
• Strong proficiency in SQL and PySpark.
• Experience with CI/CD and data orchestration tools like Airflow or Dagster.
• Understanding of data governance, security, and MLOps practices.
• Must be authorized to work in the United States.