Senior Data Engineer

TL;DR

Senior Data Engineer (SQL/Python, Big Data): Designing data models and building scalable batch and streaming pipelines to capture viewer product metrics across hirify.global devices, TVs, web, and mobile clients. Focus on fault-tolerant distributed processing, petabyte-scale warehousing, and performance tuning on large production clusters.

Location: Austin, United States

Company

hirify.global powers the TV streaming ecosystem by connecting consumers, content publishers, and advertisers.

What you will do

• Build highly scalable, available, and fault-tolerant distributed data processing systems (batch and streaming) for tens of terabytes ingested daily and a petabyte-scale data warehouse.
• Design and refine data solutions and simplified data models that enable self-service analytics.
• Develop resilient data pipelines optimized for data quality, including handling poor-quality sources.
• Own data mapping, business logic, transformations, and data quality standards.
• Perform low-level debugging, performance measurement, and optimization on large production clusters.
• Participate in architecture discussions, influence the product roadmap, and take ownership of projects from inception to delivery.

Requirements

• 8+ years of professional experience as a Data Engineer.
• Extensive SQL skills, including writing complex optimized queries.
• Proficiency in at least one scripting language (Python preferred).
• Experience with big data technologies such as Hadoop (HDFS, YARN, MapReduce), Hive, Kafka, Spark, Airflow, and Presto/Trino.
• Deep expertise in Apache Spark, including performance tuning and building scalable batch and streaming pipelines.
• Experience with data modeling (conceptual, logical, and physical) and collaborating with cross-functional teams.

Nice to have

• Experience with AWS, GCP, or Looker.
• AI literacy and an AI growth mindset.
• BS in Computer Science or related field; MS preferred.

Culture & Benefits

• Hybrid work approach: office Monday through Thursday; Fridays are flexible for remote work unless the role requires being in the office five days a week.
• Comprehensive benefits including global access to mental health and financial wellness support.
• Local benefits may include healthcare (medical, dental, vision), life/accident/disability coverage, commuter benefits, and retirement options (401(k)/pension).
• Time off supported according to local leave policies.

Hiring process

• Application review and evaluation of fit for the role.
• Accommodation support available during the hiring process if needed.