3 дня назад
Backend Engineer (Big Data)
156 500 - 235 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Backend Engineer (Big Data): Designing and evolving a petabyte-scale activation platform with an accent on distributed data processing, multi-regional architecture, workflow orchestration, and streaming delivery. Focus on building Spark and SingleStore pipelines, optimizing fairness and cost across multi-tenant workloads, and improving production reliability and observability.
Location: Hybrid in San Francisco, Little Rock, New York, or Seattle, United States
Annual base compensation: $156,500–$235,000
Company
builds data collaboration infrastructure for brands, retailers, financial services providers, and healthcare innovators, supporting large-scale marketing and customer data activation.
What you will do
- Design and evolve a petabyte-scale activation platform toward a delta-first, cache-aware, cost-efficient architecture.
- Build distributed data pipelines with Apache Spark, Dataproc, SingleStore, Kubernetes/GKE, and streaming systems such as Pub/Sub and Redpanda/Kafka.
- Develop workflow orchestration and scheduling with Temporal, Cadence, queues, capacity pools, rate limits, and destination-specific SLAs.
- Improve multi-tenant fairness, latency, scalability, cache utilization, cluster sizing, autoscaling, and compute costs.
- Own production services, incident response, postmortems, observability, SLOs, and structural reliability improvements.
- Mentor engineers, lead design and code reviews, and represent Activations Backend in architecture discussions.
Requirements
- 5+ years of experience writing and deploying production code in Java, Go, Scala, or a similar modern language.
- Experience designing and delivering large-scale distributed or big data systems with measurable business impact.
- Strong data engineering and SQL skills, including complex queries and performance, correctness, and cost analysis on very large tables.
- End-to-end data pipeline experience covering ingestion, transformation, orchestration, failure handling, and observability.
- Experience with cloud and containerized environments, ideally GCP and Kubernetes/GKE.
- Ability to define technical strategy, collaborate across teams, communicate clearly, and mentor engineers.
Nice to have
- Experience with GCP services including GCS, Dataproc, GKE, Pub/Sub, BigQuery, and IAM.
- Experience with Temporal, Cadence, Airflow, or similar workflow orchestration systems.
- Experience with SingleStore, BigQuery, Snowflake, or similar data warehouses.
- Experience with high-volume streaming, multi-tenant rate limiting, fairness, SLA enforcement, and large-scale performance optimization.
- Background in advertising, marketing, data activation, or similarly scale- and correctness-sensitive platforms.
Culture & Benefits
- Work in a hybrid environment across 's engineering locations.
- Collaborate with Identity, Data Foundation, Activations Fullstack, and Integrations/OPI teams.
- Use AI-enhanced tools for coding, design exploration, data analysis, and operational debugging.
- Participate in technical strategy, architecture forums, incident response, and continuous operational improvement.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
6 дней назад
Backend Engineer
192 000 - 281 000$
Thinking Machines Lab
4 дня назад
Data Infrastructure Engineer (AI)
300 000 - 400 000$
6 дней назад
MarTech LiveRamp Clean Room Engineer (Habu)
100 000 - 130 000$
4 дня назад
Senior Data Platform Engineer (AI)
125 000 - 205 000$
Baseten
6 дней назад
Partner Engineer (AI)
265 000 - 330 000$
Baseten
8 дней назад
Engineer (Enterprise AI Platform)
165 000 - 330 000$