3 дня назад
Senior Data Infrastructure Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Data Infrastructure Engineer (AI): Building scalable pipelines for structured data and massive unstructured assets such as images, videos, and 3D models to support large-scale AI model training with an accent on distributed processing, dataset quality, and training readiness. Focus on optimizing Spark/Ray/Flink workloads, managing cloud data lakes and Kubernetes infrastructure, and ensuring reproducible preprocessing pipelines.
Location: Shanghai, China; hybrid
Company
is a Silicon Valley-headquartered 3D generative AI company developing tools that transform text and images into 3D models.
What you will do
- Design and maintain scalable ETL/ELT pipelines for structured data and large volumes of images, videos, and 2D/3D assets.
- Optimize distributed data processing with Spark, Ray, and Flink on cloud object storage and data lakes.
- Implement data sharding, caching, monitoring, and alerting to improve processing and storage efficiency.
- Prepare, transform, and verify datasets for AI model pre-training and fine-tuning, including format conversion, enhancement, and feature extraction.
- Ensure dataset lineage and reproducibility while collaborating with ML research and engineering teams worldwide.
- Manage infrastructure with Terraform and Kubernetes and promote CI/CD practices.
Requirements
- 5+ years of experience in data engineering or distributed systems development.
- Experience building pipelines for large-scale structured and unstructured data.
- Knowledge of the machine learning training workflow, including pre-training, fine-tuning, or reinforcement learning.
- Practical experience with Kubernetes distributed workload orchestration or GPU/HPC clusters.
- Experience with Terraform, cloud object storage, data lakes, and distributed processing frameworks.
- Basic English communication skills sufficient for all-English meetings and written communication.
Nice to have
- Experience processing 2D/3D assets, including geometric and texture transformations.
- Familiarity with Blender, Unity, or Unreal Engine for compositing data generation.
- Experience with Databricks, Snowflake, BigQuery, or similar data warehouse and lakehouse platforms.
- Open-source contributions to ML infrastructure or distributed systems.
- Knowledge of data security and compliance.
Culture & Benefits
- Flexible work environment with remote and on-site options within the hybrid role structure.
- Competitive salary, equity, stock options for core team members, and benefits.
- 401(k) plan and comprehensive health, dental, and vision insurance.
- Unlimited, flexible time off and opportunities for professional growth.
- Inclusive culture focused on creativity, innovation, quality, and collaboration.
- Modern office equipment and work with 3D generative AI technology.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
Reddit
1 день назад
Senior Machine Learning Systems Engineer (AI)
216 700 - 303 400$
1 день назад
Senior Machine Learning Engineer (AI)
6 часов назад
AI Operations Engineer
150 000 - 165 000$
2 часа назад
AI Data Engineer
100 000 - 150 000$
15 часов назад
AWS Data Engineer
80 420 - 106 050$
2 дня назад