Senior Data Engineer (Spark/Kafka)

Location: New York, New York, United States

Salary: $130,000–$170,000 USD per year

Company

hirify.global is an advertising technology platform that helps brands, publishers, and platforms improve digital advertising through creative formats, audience targeting, and data-driven solutions.

What you will do

• Create and maintain scalable data pipeline architecture.
• Explore and assemble large, complex datasets based on functional and non-functional requirements.
• Automate manual processes and improve data delivery, infrastructure scalability, and internal workflows.
• Build extraction, transformation, and loading infrastructure using Spark, EMR, Kafka, and other big data technologies.
• Work with product managers, engineers, analysts, and other stakeholders to resolve data-related technical issues and support data infrastructure needs.

Requirements

• Bachelor’s degree in Computer Science, a related technical field, or equivalent professional experience.
• At least 5 years of professional software engineering experience focused on production data and ML processes at scale.
• Experience optimizing Spark and Kafka big data and ML pipelines at scale.
• Knowledge of ML and AI operations and processes.
• Understanding of database technologies such as OpenSearch, Druid, ClickHouse, and InfluxDB.
• Strong SQL skills and expertise in Python, Scala, or Java, with experience in cross-functional data modeling.

Nice to have

• Experience with MLflow, Feast, Ray, and other AI training technologies.
• Experience with containerization, Kubernetes, and ArgoCD.

Culture & Benefits

• Collaborative, positive, and supportive workplace culture.
• Flexible paid time off.
• Medical, dental, and vision plans for eligible full-time employees.
• 401(k) with employer match.
• Additional bonuses and region-specific benefits may be available.