Senior Data Engineer (Scala)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Data Engineer (Scala): Building and optimizing large-scale batch and streaming data pipelines for a global advertising platform with an accent on scalability, data consistency, and reliability. Focus on handling internet-scale data volumes and optimizing infrastructure costs for 400+ billion daily events.
Location: Hybrid (T/W/TH in-office). Must be based in one of the following US states: AZ, CA, CO, FL, GA, ID, IL, MA, MI, MT, NE, NJ, NY, NC, OK, OR, PA, SC, TX, UT, VA, WA
Salary: $150,000 - $170,000 per year
Company
is the world’s largest independent sell-side advertising platform, fueling billions of transactions daily across CTV, streaming, video, display, and audio.
What you will do
- Architect and build systems to process massive data volumes to empower business consumers.
- Maintain and optimize data pipelines handling 400+ billion events per day.
- Implement scalable infrastructure to handle peak traffic and seasonal shifts.
- Optimize infrastructure costs to improve profit margins.
- Ensure data consistency and reliability across cloud-based and on-prem systems.
- Collaborate and mentor other engineers within the data engineering group.
Requirements
- 5+ years of software development experience.
- BS/MS in Computer Science or equivalent work experience.
- Proficiency in Scala and Spark for batch and streaming pipelines.
- Experience with Java-based real-time event processing.
- Eligible for employment only in specific US states: AZ, CA, CO, FL, GA, ID, IL, MA, MI, MT, NE, NJ, NY, NC, OK, OR, PA, SC, TX, UT, VA, WA
Nice to have
- Experience with Databricks.
- Knowledge of Terraform, Docker, and Jenkins for CI/CD.
- Experience with Airflow for job orchestration.
- Familiarity with AWS services including RDS, EC2, S3, Kinesis, and ECS.
Culture & Benefits
- Comprehensive healthcare coverage from day one.
- 401k retirement savings plan with employer match.
- Equity and Employee Stock Purchase Plan.
- Generous time off, including holiday breaks and Summer Fridays.
- Wellness support, including mental health and fitness reimbursement.
- Career development framework and peer-to-peer recognition.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →