Senior Data Engineer (Databricks)

Location: Hybrid, New York City office; minimum three days per week onsite

Salary: USD 140,000–160,000 per year

Company

hirify.global is a media and entertainment company operating brands across political news, business news, golf, sports, and genre entertainment, supported by digital assets including Fandango, Rotten Tomatoes, GolfNow, and GolfPass.

What you will do

• Design and scale Delta Lake lakehouse architecture using Bronze, Silver, and Gold medallion pipeline patterns.
• Build and operate batch and real-time ingestion pipelines with Databricks Auto Loader, Structured Streaming, and change data capture.
• Implement data governance and security with Unity Catalog, role-based access control, and compliance-driven practices.
• Optimize Spark performance and cloud costs through cluster sizing, workload tagging, Spark tuning, Photon acceleration, and FinOps strategies.
• Develop CI/CD pipelines and orchestration workflows using Databricks Workflows, Delta Live Tables, Airflow, or comparable tools.
• Partner with Data Science, Analytics, Data Product, and Engineering teams on ML workflows, data quality, observability, lineage, and technical mentorship.

Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience.
• 5+ years of experience building production-grade cloud data pipelines with Spark-based platforms such as Databricks, EMR, or Dataproc.
• Strong PySpark, SQL, and distributed data-processing skills, including experience with Spark, Flink, or Presto.
• Experience with batch or streaming pipelines, event-driven and distributed systems, orchestration, monitoring, alerting, and data quality.
• Proficiency with Git, CI/CD, infrastructure, networking, and data security fundamentals.
• Ability to work from the New York City office at least three days per week in a hybrid arrangement.

Nice to have

• Experience with Databricks lakehouse platforms, medallion pipelines, Unity Catalog, Lakeflow Spark Declarative Pipelines, MLflow, feature stores, or MLOps.
• Background in media and entertainment data, ad technology, audience analytics, event logs, clickstream data, or large-scale analytical datasets.
• Infrastructure-as-code experience, Databricks or cloud certifications, and familiarity with AI-assisted development tools.

Culture & Benefits

• Hands-on ownership of production data systems and collaboration across technical and data-focused teams.
• Opportunities to provide mentorship through code reviews, pairing, and knowledge sharing.
• Medical, dental, and vision insurance.
• 401(k), paid leave, tuition reimbursement, and additional benefits and perks.

Hiring process

• External candidates may be required to attend an in-person interview with a hirify.global employee in New York before a hiring decision.