6 часов назад
ML Data Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
ML Data Engineer (Python/PyTorch): Building reliable data processing and quality systems for multimodal foundation models at petabyte scale with an accent on dataset composition, provenance, and distributed compute. Focus on designing unbiased data experiments, automating data quality assessment, and optimizing throughput, storage, and compute utilization across training pipelines.
Location: Remote in the US, UK, or Singapore
Company
is a globally distributed foundation model startup building multimodal artificial intelligence for organizations and businesses.
What you will do
- Define data quality metrics, validation checks, and acceptance thresholds with model researchers.
- Explore open-source datasets and create internal datasets for fundamental world models.
- Build algorithms for automated data quality assessment, data domain mixtures, and synthetic-to-real domain adaptation.
- Track dataset metadata, provenance, and versions to make training and evaluation experiments reproducible.
- Own CI/CD and development tooling for the data stack and automate repetitive workflows.
- Monitor and optimize pipeline throughput, storage, and compute utilization.
Requirements
- Strong machine learning and deep learning fundamentals with experience operating large-scale data or compute systems.
- Experience moving between research and production engineering, including data analysis and reliable system development.
- Research experience with data composition, data quality, and dataset releases.
- Ability to design and execute experiments with convincing unbiased outcomes.
- Practical experience with distributed processing and orchestration using Spark, Ray, Airflow, or equivalent tools.
- Solid Python skills and familiarity with datasets, checkpoints, and experiment-tracking workflows.
Nice to have
- Experience with large video datasets, dataset curation for training, or internal tooling for ML evaluation and analysis.
Culture & Benefits
- Remote-first, globally distributed working environment.
- Collaborative and mission-driven culture with an emphasis on inclusive, open communication.
- Five weeks of paid leave.
- Comprehensive healthcare benefits, including vision and dental coverage.
- Visa assistance, including H1B and OPT transfers, is available for US employees.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →