Senior Software Engineer (Data Engineering)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Senior Software Engineer (Data Engineering): Developing and implementing real-time streaming data pipelines to process billions of user signals with an accent on sub-second latency and high-throughput reliability. Focus on building scalable Kafka-based streaming infrastructure and leveraging Apache Dataflow to ensure data freshness for large-scale identity and advertising insights.
Salary: $128,250 - $266,875/yr
Company
is a global technology company providing digital products and omnichannel advertising solutions to hundreds of millions of users.
What you will do
- Develop and optimize real-time streaming pipelines for user event ingestion and third-party ID mutations.
- Build scalable Kafka-based infrastructure capable of handling millions of events per second with exactly-once processing.
- Implement Apache Dataflow and Beam jobs for complex stream processing, enrichment, and data validation.
- Collaborate with storage and platform teams to design high-throughput Cloud Spanner write patterns.
- Design monitoring, error handling, and data quality frameworks to ensure pipeline SLA compliance.
- Participate in on-call rotations to maintain production streaming services with 99.9% uptime.
Requirements
- Bachelor's degree in Computer Science, Data Engineering, or a related technical field.
- 5+ years of experience building production data systems.
- 3+ years of hands-on experience with real-time/streaming data processing systems at scale.
- 2+ years of experience with GCP (Dataflow, Pub/Sub, BigQuery, Spanner) or AWS equivalents.
- Strong proficiency in Python, Java, or Scala.
- Demonstrated expertise in distributed messaging systems like Kafka or Pub/Sub.
Nice to have
- Experience with high-throughput Cloud Spanner write patterns.
- Knowledge of adtech, identity platforms, or consumer data systems.
- Familiarity with schema registry management and event-driven architectural patterns.
- Contributions to open-source streaming projects such as Apache Beam or Kafka.
Culture & Benefits
- Flexible hybrid work options with occasional in-person team sessions.
- Comprehensive benefits including healthcare and 401k plans.
- Support for professional development through education stipends.
- Inclusive environment with 11 active employee resource groups (ERGs).
- Access to backup childcare and other employee support programs.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →