Machine Learning Data Engineer (DataOps)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Machine Learning Data Engineer (DataOps): Building and unifying data infrastructure for model training pipelines with an accent on automated ingestion, data quality validation, and dataset versioning. Focus on designing scalable ETL/ELT pipelines and bridging the gap between operations and ML engineers to ensure reliable model training.
Location: Mountain View, CA
Salary: $166,000 - $244,000
Company
, The Moonshot Factory is an innovation hub developing technology to radically reduce global waste and enable a circular economy using AI and robotics.
What you will do
- Architect and build automated ETL/ELT data pipelines to aggregate, clean, and harmonize data from disparate sources and databases.
- Implement DataOps practices, including data quality monitoring, automated schema validation, and anomaly detection.
- Standardize and integrate third-party annotation workflows and remote labeling feeds into unified training datasets.
- Design and maintain dataset versioning and storage systems to ensure reproducible machine learning eperiments.
- Collaborate with ML engineers and operations teams to translate raw sensor metadata into structured training features.
Requirements
- Degree in Computer Science, Data Engineering, Software Engineering, or a related technical field.
- 3+ years eperience building scalable data pipelines and managing relational/non-relational databases.
- Epertise in Python and data manipulation libraries such as Pandas, NumPy, or SQL.
- Practical eperience implementing automated data validation, quality control frameworks, and dataset versioning.
- Hands-on eperience structuring datasets for ML workflows, including annotation and metadata tracking.
Nice to have
- Eperience with Google Cloud Platform (BigQuery, Cloud Storage, Dataflow, Dataproc, Verte AI).
- Proficiency in workflow orchestration using Google Cloud Composer, Apache Airflow, Prefect, or Dagster.
- Eperience handling multimodal and unstructured data, including image datasets and sensor metadata.
- Familiarity with human-in-the-loop workflows and data labeling platform integrations.
- Eposure to ML versioning and quality tools like DVC, Great Epectations, or TF.
Culture & Benefits
- Competitive base salary, bonus, and equity.
- Comprehensive benefits package.
- Commitment to an equal opportunity workplace that celebrates diversity and inclusion.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →