Senior Big Data Engineer (AdTech)

TL;DR

Senior Big Data Engineer (AdTech): Designing and maintaining enterprise big data platforms supporting large-scale processing and analytics with an accent on distributed systems like Kafka, Hadoop, and Aerospike. Focus on automating infrastructure deployment, optimizing platform performance, and ensuring high availability in 24x7 production environments.

Location: Hybrid in New York, NY (T/W/Th in-office) or U.S. Remote

Salary: $170,000 – $180,000

Company

hirify.global is the world's largest independent sell-side advertising platform, enabling publishers to monetize content across all screens and formats.

What you will do

• Design, deploy, and optimize enterprise Big Data platforms including Apache Kafka, Hadoop/MapR, and Aerospike.
• Build highly available, scalable, and resilient data infrastructure across multiple data centers.
• Perform capacity planning, performance tuning, and root cause analysis for production environments.
• Automate infrastructure deployment and operational workflows using Terraform, Ansible, and Puppet.
• Implement monitoring and observability solutions using Grafana, Prometheus, and Graphite.
• Participate in production support and on-call rotations for critical infrastructure.

Requirements

• 4+ years of experience supporting large-scale Linux infrastructure (RHEL, Rocky Linux, CentOS).
• 4+ years of experience administering distributed Big Data platforms.
• Strong expertise with Apache Kafka, Hadoop (MapR, Cloudera), and Aerospike.
• Experience with relational databases such as PostgreSQL and MySQL.
• Proficiency in shell scripting using Bash or Python.
• Must be based in the United States.

Nice to have

• Experience with Kubernetes and containerized workloads.
• Knowledge of Ceph or other distributed storage platforms.
• Experience with AWS and CI/CD pipelines.
• Familiarity with Spacelift.

Culture & Benefits

• Comprehensive healthcare coverage starting from day one.
• 401k retirement savings plan with employer match.
• Equity and Employee Stock Purchase Plan.
• Generous time off, holiday breaks, and quarterly wellness days.
• Family-focused benefits, parental leave, and cell phone subsidy.
• Hybrid work culture with catered lunches and office events in NY.