обновлено 5 дней назад
Machine Learning Data Engineer (DataOps)
164 000 - 261 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Machine Learning Data Engineer (DataOps): Building and unifying data infrastructure for model training pipelines with an accent on automated ingestion, data quality validation, and dataset versioning. Focus on designing scalable ETL/ELT pipelines and bridging the gap between operations and ML engineers to ensure reliable model training.
Location: Mountain View, California, United States
Base salary: $164,000–$261,000 annually, plus bonus, equity, and benefits.
Company
's Materra team develops AI and robotics technology that identifies waste materials at the molecular level and helps recycling centers process plastics more affordably and at scale.
What you will do
- Architect and build automated ETL and ELT pipelines that aggregate, clean, and harmonize data from fragmented sources.
- Implement DataOps practices, including data quality monitoring, schema validation, and anomaly detection.
- Integrate third-party annotation workflows and remote labeling feeds into unified datasets for model training.
- Design and maintain dataset versioning and storage systems for reproducible machine learning eperiments.
- Collaborate with machine learning engineers and operations teams to convert material, form-factor, and sensor metadata into structured training features.
Requirements
- Degree in computer science, data engineering, software engineering, or a related technical field.
- 5+ years of eperience building scalable data pipelines, managing relational and non-relational databases, and unifying fragmented data storage systems.
- Epertise in Python and data manipulation libraries such as Pandas, NumPy, or SQL.
- Practical eperience with automated data validation, data quality frameworks, and dataset versioning.
- Hands-on eperience structuring datasets for machine learning workflows, including annotations, metadata tracking, and training-set curation.
Nice to have
- Eperience with Google Cloud tools such as BigQuery, Cloud Storage, Dataflow, Dataproc, or Verte AI Data Pipelines.
- Eperience with workflow orchestration frameworks such as Cloud Composer, Apache Airflow, Prefect, or Dagster.
- Eperience handling image datasets, sensor metadata, and unstructured physical-property records.
- Familiarity with data-labeling platforms, human-in-the-loop workflows, or annotation APIs.
- Eposure to Great Epectations, DVC, TF, or Data Validation.
Culture & Benefits
- Full-time employment with bonus, equity, and benefits.
- Equal employment opportunity and affirmative action workplace.
- Reasonable accommodations are available for candidates with disabilities or special needs.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
Top Selection
6 дней назад
Data Engineer (MLOps)
280 000 - 300 000₽
6 дней назад
Senior Data Engineer (AI)
119 514 - 164 899$
Anthropic
8 дней назад
Analytics Data Engineer (AI)
320 000 - 405 000$
5 дней назад
Manager, Analytics Engineering
165 000 - 195 000$
10 дней назад
Data Engineering Specialist – AI
100 000 - 150 000$
6 дней назад
Software Engineer – Data Platform (Databricks)
105 000 - 130 000$