Senior Software Engineer (Data Engineering)
ΠΡΡΡ & Π‘ΠΎΠΏΡΠΎΠ²ΠΎΠ΄
ΠΠ»Ρ ΠΌΡΡΡΠ° Ρ ΡΡΠΎΠΉ Π²Π°ΠΊΠ°Π½ΡΠΈΠ΅ΠΉ Π½ΡΠΆΠ΅Π½ Plus
ΠΠΏΠΈΡΠ°Π½ΠΈΠ΅ Π²Π°ΠΊΠ°Π½ΡΠΈΠΈ
TL;DR
Senior Software Engineer (Data Engineering): Developing and implementing real-time streaming data pipelines to process billions of user signals with an accent on sub-second latency and high-throughput reliability. Focus on building scalable Kafka-based streaming infrastructure and leveraging Apache Dataflow to ensure data freshness for large-scale identity and advertising insights.
Salary: $128,250 - $266,875/yr
Company
is a global technology company providing digital products and omnichannel advertising solutions to hundreds of millions of users.
What you will do
- Develop and optimize real-time streaming pipelines for user event ingestion and third-party ID mutations.
- Build scalable Kafka-based infrastructure capable of handling millions of events per second with exactly-once processing.
- Implement Apache Dataflow and Beam jobs for complex stream processing, enrichment, and data validation.
- Collaborate with storage and platform teams to design high-throughput Cloud Spanner write patterns.
- Design monitoring, error handling, and data quality frameworks to ensure pipeline SLA compliance.
- Participate in on-call rotations to maintain production streaming services with 99.9% uptime.
Requirements
- Bachelor's degree in Computer Science, Data Engineering, or a related technical field.
- 5+ years of experience building production data systems.
- 3+ years of hands-on experience with real-time/streaming data processing systems at scale.
- 2+ years of experience with GCP (Dataflow, Pub/Sub, BigQuery, Spanner) or AWS equivalents.
- Strong proficiency in Python, Java, or Scala.
- Demonstrated expertise in distributed messaging systems like Kafka or Pub/Sub.
Nice to have
- Experience with high-throughput Cloud Spanner write patterns.
- Knowledge of adtech, identity platforms, or consumer data systems.
- Familiarity with schema registry management and event-driven architectural patterns.
- Contributions to open-source streaming projects such as Apache Beam or Kafka.
Culture & Benefits
- Flexible hybrid work options with occasional in-person team sessions.
- Comprehensive benefits including healthcare and 401k plans.
- Support for professional development through education stipends.
- Inclusive environment with 11 active employee resource groups (ERGs).
- Access to backup childcare and other employee support programs.
ΠΡΠ΄ΡΡΠ΅ ΠΎΡΡΠΎΡΠΎΠΆΠ½Ρ: Π΅ΡΠ»ΠΈ ΡΠ°Π±ΠΎΡΠΎΠ΄Π°ΡΠ΅Π»Ρ ΠΏΡΠΎΡΠΈΡ Π²ΠΎΠΉΡΠΈ Π² ΠΈΡ ΡΠΈΡΡΠ΅ΠΌΡ, ΠΈΡΠΏΠΎΠ»ΡΠ·ΡΡ iCloud/Google, ΠΏΡΠΈΡΠ»Π°ΡΡ ΠΊΠΎΠ΄/ΠΏΠ°ΡΠΎΠ»Ρ, Π·Π°ΠΏΡΡΡΠΈΡΡ ΠΊΠΎΠ΄/ΠΠ, Π½Π΅ Π΄Π΅Π»Π°ΠΉΡΠ΅ ΡΡΠΎΠ³ΠΎ - ΡΡΠΎ ΠΌΠΎΡΠ΅Π½Π½ΠΈΠΊΠΈ. ΠΠ±ΡΠ·Π°ΡΠ΅Π»ΡΠ½ΠΎ ΠΆΠΌΠΈΡΠ΅ "ΠΠΎΠΆΠ°Π»ΠΎΠ²Π°ΡΡΡΡ" ΠΈΠ»ΠΈ ΠΏΠΈΡΠΈΡΠ΅ Π² ΠΏΠΎΠ΄Π΄Π΅ΡΠΆΠΊΡ. ΠΠΎΠ΄ΡΠΎΠ±Π½Π΅Π΅ Π² Π³Π°ΠΉΠ΄Π΅ β