Data Engineer (Databricks)

TL;DR

Data Engineer (Databricks/Airflow): Designing, building, and scaling foundational data infrastructure that powers analytics and machine learning with an accent on pipeline reliability, performance, and cost-efficiency. Focus on building scalable ETL/ELT pipelines, optimizing distributed compute, and improving developer experience for high-impact data workloads.

Location: Hybrid (New York City)

Salary: $125,000 - $163,800 USD

Company

hirify.global is a premier mobile gaming company in the United States and Canada, operating leading brands in sports betting and iGaming.

What you will do

• Design, develop, and deliver scalable data pipelines and platform components using Databricks and Airflow.
• Optimize data workflows by identifying bottlenecks and implementing performance improvements independently.
• Lead design and code reviews to set high standards for code quality, testability, and engineering excellence.
• Drive architectural decisions regarding pipeline design, data modeling, and tooling trade-offs.
• Ensure operational excellence for production pipelines through monitoring, alerting, and incident response.
• Mentor junior engineers and partner with analytics and data science teams to drive platform adoption.

Requirements

• 3+ years of experience with Apache Airflow, including building and maintaining production DAGs.
• 3+ years of professional Python development in a data engineering context.
• 3+ years of experience with Databricks and Delta Lake for ETL/ELT pipeline delivery.
• Strong experience with cloud environments (AWS, Azure, or GCP), including IAM and secure data access.
• Proficiency with Terraform (IaC), Git-based workflows, and CI/CD practices.
• Ability to independently scope and deliver solutions for ambiguous technical problems.

Nice to have

• Experience with dbt for transformation layers.
• Familiarity with data observability tools like Monte Carlo or Datafold.
• Knowledge of data governance, privacy, and compliance practices.
• Experience supporting BI and data science teams in an infrastructure capacity.

Culture & Benefits

• Comprehensive health plans (medical, vision, dental) with some options as low as $0 per paycheck.
• 401(k) matching program up to 5%.
• Generous paid time off (PTO), sick leave, and 14 paid company holidays.
• Annual performance-based bonuses and long-term incentive opportunities.
• Additional perks including commuter benefits and pet insurance.