Назад
Company hidden
3 дня назад

Senior ML Data Processing Developer (AI)

Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Canada/Germany
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior ML Data Processing Developer (AI): Building and scaling data pipelines that transform web-scale data into high-signal training datasets for Scientist AI with an accent on algorithmic filtering, model-based scoring, privacy, and benchmark integrity. Focus on designing novel data transformations, preventing evaluation leakage, and optimizing distributed processing for massive unstructured text datasets.

Location: Berlin, Germany or Montreal, Quebec, Canada

Company

hirify.global is a non-profit research organization developing safe-by-design AI systems that primarily understand the world and provide truthful answers through transparent, externalized probabilistic reasoning.

What you will do

  • Define, build, automate, scale, and manage pipelines that transform raw web-scale data into training datasets for Scientist AI.
  • Develop processing capabilities for deduplication, model-based quality scoring, heuristic filtering, toxicity removal, PII scrubbing, metadata extraction, proprietary transformations, dataset versioning, and provenance tracking.
  • Build scoring and filtering tools using heuristics, LLM-as-a-judge evaluators, ML classifiers, metadata extraction, and human-in-the-loop review workflows.
  • Instrument pipelines with data-quality monitoring, guardrails, and alerting, and maintain leakage detection to prevent evaluation contamination.
  • Analyze corpus coverage, acquire suitable large-scale text data, develop targeted acquisition strategies, and collaborate on data licensing.
  • Build internal tools and interfaces for researchers to explore, query, and understand datasets.

Requirements

  • Degree in computer science, software engineering, or a related field.
  • 5+ years of experience in data processing, machine learning engineering, or NLP, including work with massive unstructured text datasets at trillion-token scale.
  • Hands-on experience with distributed processing frameworks such as Spark, Ray, or Flink, including high-throughput pipeline design and optimization.
  • Experience implementing data privacy measures such as PII scrubbing, content-safety filtering for toxicity and bias, and evaluation-contamination prevention.
  • Ability to collaborate across Research, Engineering, and/or Legal/Governance teams and translate requirements into pipeline work.
  • Strong Python proficiency and experience writing production-grade data-processing code.
  • Experience with pipeline orchestration frameworks such as Airflow, Prefect, or Dagster.

Nice to have

  • Experience training, fine-tuning, or deploying ML models for data-quality tasks and familiarity with LLM inference optimization tools such as vLLM or SGLang.
  • Familiarity with Docker, Kubernetes, and infrastructure-as-code practices.
  • Familiarity with ML experiment tracking tools such as Weights and Biases.
  • Experience with data licensing workflows or web-scale data acquisition.
  • Contributions to open-source data-processing or NLP tooling.

Culture & Benefits

  • Work in a fair, open, respectful, inclusive, and collaborative environment.
  • Contribute to AI research intended as a global public good and focused on safe-by-design systems.
  • Personal information is processed to evaluate applications in compliance with applicable privacy laws, with rights described in hirify.global’s Privacy Policy.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →