aipythonsparkdata pipelinesdata qualitydata ingestioncloud data engineeringstorage optimization
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
Выше рынка
$290к-340к/год
$170к$200кмедиана$230к
По похожим ролям (48) ~ $200к/год
На СНГ рынке: $3.6к/мес ($3к - $4.3к)
91
Крутая вакансия
развернуть
У роли четкий и значимый фокус на данных петабайтного масштаба в сильной сфере AI и автономного вождения; главный компромисс - процессы в компании еще формируются.
Кликните для подробной информации
Выше рынкаПередовая сфераСовременный стекЧеткая зона ответственностиПроцессы формируютсяПоддержка развития
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Senior Data or Software Engineer (AI): Building filtering, retention, offload, and data movement systems for autonomous-driving datasets at hundreds of petabytes with an accent on Python, Spark, cloud data engineering, and data quality. Focus on designing low-compute pre-ingestion decisions, balancing storage and compute costs against data value, and preserving useful behavioral and environmental coverage for model training.
Location: Sunnyvale, California, USA; hybrid working model with in-person collaboration and remote work
Salary: $290K–$340K
Company
hirify.global is building an AI platform for autonomous driving that learns from real-world driving experience and supports scalable deployment across vehicle manufacturers.
What you will do
Implement and iterate filtering, retention, offload, and deletion policies across hot, cold, archive, and delete storage.
Build data movement and ingestion pipelines supporting pre-ingestion selection models.
Design where and how selection models run while balancing compute cost and data value.
Build early, low-compute decision points that prevent expensive standardisation and enrichment of low-value data.
Monitor data quality and ensure datasets provide useful behavioral and environmental coverage for model training.
Work closely with the dataset strategy lead, data infrastructure, storage, and vehicle-related teams to ship practical solutions.
Requirements
Senior data or software engineering experience running data ingestion or data quality pipelines at petabyte scale.
Strong Python and Spark skills.
Cloud data engineering experience.
Good judgement in data filtering and quality, including checking that valuable data has not been discarded.
Ability to ship practical solutions quickly and iterate on live systems.
Software engineering experience building systems around models rather than models themselves.
Ability and interest to work closely with data infrastructure and storage teams.
Nice to have
Experience in AV, robotics, fleet data, high-volume IoT, or retention, offload, and data lifecycle policies.
Passion for autonomy and willingness to learn even without meeting every qualification.
Culture & Benefits
Hybrid working with core hours, dedicated offices, and opportunities to work hands-on in vehicle workshops and labs.
Meaningful equity and salaries benchmarked against the market annually.
Relocation support and visa sponsorship where applicable.
Learning and development budgets for training, conferences, and growth.
Health insurance, dental coverage, enhanced maternity and paternity leave, retirement or pension provisions where applicable, therapist access, and wellbeing partner discounts.
Ownership in an evolving environment where working practices are still being developed.
Hiring process
Initial recruiter screen: 30 minutes.
Hiring manager introduction: 1 hour; competency interviews covering system design and technical leadership: 2 hours; domain deep dive: 1 hour.
Final mission and values alignment interview: 1 hour.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →