7 дней назад
Data Engineer (AI)
209 700 - 266 800$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Engineer (AI) (Spark/Python): Building and operating petabyte-scale ingestion pipelines for real-world driving data used in annotation, model training, and evaluation with an accent on reliability, throughput, and operational efficiency. Focus on debugging corrupt data and stalled workflows, optimizing Spark batch processing, and designing resilient recovery across complex queues and dependencies.
Location: Sunnyvale, California, USA; hybrid working with in-person collaboration in the office and remote work.
Salary: $209,700–$266,800 annually, plus equity.
Company
builds an AI platform for autonomous driving that learns from real-world experience and supports scalable vehicle automation.
What you will do
- Debug failing ingestion pipelines, stalled jobs, processing queues, and production failures.
- Investigate corrupt, malformed, and unexpected data from multiple sources.
- Optimize Spark jobs and batch-processing pipelines for throughput, reliability, and compute efficiency.
- Operate high-volume pipelines supporting annotation, data science, model training, and evaluation.
- Improve monitoring, retries, failure recovery, and isolation of problematic data across multi-step workflows.
- Work with engineers to prioritize critical datasets and reduce operational toil.
Requirements
- Strong production experience with Apache Spark and Python.
- Experience building, operating, or debugging large-scale ingestion, ETL, or distributed data-processing pipelines.
- Ability to diagnose corrupt data, stalled queues, retries, and complex dependencies in production.
- Understanding of high-throughput system optimization for reliability, performance, and cost.
- Ability to learn existing systems quickly, work independently, and deliver practical improvements.
- Ability to work in the Sunnyvale, California hybrid setup.
Nice to have
- Experience with Airflow, Flyte, Databricks, Delta Lake, Scala, or Java.
Culture & Benefits
- Hybrid work with core hours and opportunities to work hands-on in vehicle workshops and labs.
- Relocation support and visa sponsorship where applicable.
- Market-benchmarked salary and meaningful equity.
- Learning and development budgets for training, conferences, and growth.
- Health, dental, retirement or pension, parental leave, therapy access, wellbeing partnerships, and team socials.
Hiring process
- 30-minute recruiter screen.
- 60-minute Python programming competency interview and 60-minute SQL domain deep dive.
- 45-minute final mission and values interview.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
Airwallex
12 дней назад
Staff Software Engineer, Data Platform (AI)
200 000 - 260 000$
10 дней назад
Data Engineer (AI)
10 дней назад
Data Engineer
192 000 - 281 000$
10 дней назад
Data Engineer (Cybersecurity)
192 000 - 281 000$
12 дней назад
Data Engineer, Forward Deployed Engineer (AI)
143 640 - 273 000$
Baseten
12 дней назад
Data Engineer (AI)
180 000 - 250 000$