3 дня назад
Lead Data Platform Engineer - Enterprise, Data & AI
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Lead Data Platform Engineer - Enterprise, Data & AI (Databricks/AWS): Architecting and scaling a high-throughput data fabric and AI-ready data foundations with an accent on self-healing pipelines, governance, security, and performance optimization. Focus on designing autonomous recovery frameworks, tuning compute and storage across Databricks and EMR, and building reliable CI/CD deployment systems.
Location: Foster City, California, United States; hybrid workplace
Company
Zoox develops autonomous vehicle technology and supporting AI and data systems.
What you will do
- Architect, optimize, scale, and own the enterprise and AI data platform.
- Build self-healing, high-throughput data pipelines with schema evolution, anomaly detection, circuit breakers, and automated recovery.
- Define data governance, access controls, data quality testing, metadata management, and observability standards.
- Optimize Databricks and AWS EMR compute, storage lifecycles, resource allocation, and query performance.
- Build CI/CD templates, isolated environments, testing frameworks, rollback mechanisms, and version-control standards for data assets.
Requirements
- 10+ years of hands-on experience in data platform engineering or software engineering.
- Experience architecting and scaling production-grade data foundations.
- Expertise in performance tuning, compute allocation, query optimization, and infrastructure cost reduction.
- Experience with enterprise security, RBAC, Active Directory/IAM, data masking, audit trails, retention policies, and compliance requirements.
- Experience establishing data governance, schema evolution controls, data quality audits, real-time observability, and alerting.
- Hands-on experience with CI/CD pipelines, environment isolation, version control, and automated deployment testing.
Nice to have
- Experience using LLMs or GenAI for pipeline operations, root-cause analysis, reconciliation, backfills, or anomaly detection.
- Infrastructure-as-code experience with Terraform.
- Containerization and orchestration experience with EKS.
- GPU/CPU performance optimization and experience in autonomous vehicles, robotics, or high-tech manufacturing.
Culture & Benefits
- Full-time hybrid work arrangement.
- Hands-on technical leadership focused on secure, scalable, and reliable data infrastructure.
- Opportunity to work on enterprise data and AI foundations for autonomous vehicle technology.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →