Назад
Company hidden
7 дней назад

Data Engineer (AI)

209 700 - 266 800$
Формат работы
hybrid
Тип работы
fulltime
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Data Engineer (AI) (Spark/Python): Building and operating petabyte-scale ingestion pipelines for real-world driving data used in annotation, model training, and evaluation with an accent on reliability, throughput, and operational efficiency. Focus on debugging corrupt data and stalled workflows, optimizing Spark batch processing, and designing resilient recovery across complex queues and dependencies.

Location: Sunnyvale, California, USA; hybrid working with in-person collaboration in the office and remote work.

Salary: $209,700–$266,800 annually, plus equity.

Company

hirify.global builds an AI platform for autonomous driving that learns from real-world experience and supports scalable vehicle automation.

What you will do

  • Debug failing ingestion pipelines, stalled jobs, processing queues, and production failures.
  • Investigate corrupt, malformed, and unexpected data from multiple sources.
  • Optimize Spark jobs and batch-processing pipelines for throughput, reliability, and compute efficiency.
  • Operate high-volume pipelines supporting annotation, data science, model training, and evaluation.
  • Improve monitoring, retries, failure recovery, and isolation of problematic data across multi-step workflows.
  • Work with engineers to prioritize critical datasets and reduce operational toil.

Requirements

  • Strong production experience with Apache Spark and Python.
  • Experience building, operating, or debugging large-scale ingestion, ETL, or distributed data-processing pipelines.
  • Ability to diagnose corrupt data, stalled queues, retries, and complex dependencies in production.
  • Understanding of high-throughput system optimization for reliability, performance, and cost.
  • Ability to learn existing systems quickly, work independently, and deliver practical improvements.
  • Ability to work in the Sunnyvale, California hybrid setup.

Nice to have

  • Experience with Airflow, Flyte, Databricks, Delta Lake, Scala, or Java.

Culture & Benefits

  • Hybrid work with core hours and opportunities to work hands-on in vehicle workshops and labs.
  • Relocation support and visa sponsorship where applicable.
  • Market-benchmarked salary and meaningful equity.
  • Learning and development budgets for training, conferences, and growth.
  • Health, dental, retirement or pension, parental leave, therapy access, wellbeing partnerships, and team socials.

Hiring process

  • 30-minute recruiter screen.
  • 60-minute Python programming competency interview and 60-minute SQL domain deep dive.
  • 45-minute final mission and values interview.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →