Senior Data Engineer (Databricks)

TL;DR

Senior Data Engineer (Databricks): Building the foundation of a modern data platform by designing lakehouse architectures and scaling streaming and batch pipelines with an accent on reliability and distributed systems. Focus on implementing Medallion-layer architectures, optimizing large-scale analytics queries, and managing open table formats.

Location: Must be based in the USA (specifically CA, CO, CT, FL, GA, IL, KS, MA, MD, ME, NJ, NC, NY, OR, TN, TX, VA, or WA). U.S. citizenship or lawful permanent residency is required; this position is not eligible for visa sponsorship. Not hiring within the city limits of Chicago.

Salary: $110,000 – $200,000 per year

Company

hirify.global unifies IT to simplify work for nearly 40,000 customers in 140+ countries through its Unified IT Operations Platform.

What you will do

• Design and implement Medallion-layer data architectures (Bronze, Silver, Gold) to serve analytics and data science workloads.
• Build and maintain scalable streaming and batch data pipelines using Kafka, Spark, and Airflow.
• Manage and optimize open table formats including Iceberg, Delta, and Hudi.
• Optimize large-scale analytics queries within Trino/Starburst and Databricks environments.
• Monitor pipeline health, troubleshoot data quality issues, and improve platform reliability.
• Collaborate with data scientists and product teams to deliver platform solutions for data-driven decision-making.

Requirements

• 10+ years of experience in data engineering with a focus on distributed systems.
• Hands-on experience building lakehouse architectures and Medallion layering patterns.
• Deep expertise in Apache Kafka, Apache Spark, and Apache Airflow.
• Proficiency in open table formats (Iceberg, Delta Lake, or Hudi).
• Strong proficiency in Python and SQL.
• Experience using Databricks for large-scale data processing.

Nice to have

• Hands-on experience with Trino or Starburst for distributed query execution.
• Familiarity with hybrid streaming/batch architectures and event-driven data systems.
• Experience designing Gold-layer datasets optimized for BI and self-serve analytics.

Culture & Benefits

• Hybrid remote work flexibility based on approved US states.
• Comprehensive medical, dental, and vision insurance.
• 401(k) retirement plan.
• Unlimited PTO for better work-life balance.
• Collaborative and curious community with opportunities for growth.