Назад
Company hidden
1 день назад

Research Engineering Manager (AI/STEM)

Формат работы
remote (только Brazil/Colombia)
Тип работы
fulltime
Грейд
lead
Английский
b2
Страна
Colombia/Brazil
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Research Engineering Manager (AI/STEM) (synthetic data and model evaluations): Leading research engineers building synthetic data pipelines, rigorous benchmarks, and reinforcement learning environments for frontier AI labs with an accent on data quality, evaluation methodology, and reproducibility. Focus on designing experiments, scaling verifiers and evaluation harnesses, measuring downstream model impact, and setting technical direction while remaining hands-on with code.

Location: Global - Remote; listed locations include Brazil and Colombia

Company

hirify.global builds high-quality datasets, reinforcement learning environments, benchmarks, and agentic AI systems for frontier AI labs and enterprises.

What you will do

  • Build and lead a team of research engineers, including hiring, planning, coaching, performance management, and technical standards.
  • Partner with research scientists to define hypotheses, experiments, baselines, ablations, and research agendas.
  • Own synthetic data pipelines for generation, verification, filtering, deduplication, versioning, expert review, and downstream impact measurement.
  • Design and ship benchmarks and evaluation harnesses with calibrated difficulty, contamination controls, deterministic execution, confidence intervals, and reproducibility.
  • Write code weekly on high-leverage verifier, evaluation, and pipeline components; at least one third of the role is expected to be direct technical work.
  • Work with frontier AI labs and internal delivery and engineering teams to define acceptance criteria, explain results, and bring research into client work and platforms.

Requirements

  • 8+ years of hands-on ML or research engineering experience, including at least 5 years in industry and 3+ years directly managing research engineers, ML engineers, or researchers; hiring and performance management experience is required.
  • Experience owning production synthetic or curated data pipelines whose output drove training decisions, with demonstrated quality and downstream impact measurement.
  • Experience designing and shipping LLM evaluations or benchmarks used for model decisions; knowledge of contamination, saturation, judge bias, inter-annotator agreement, variance, and confidence intervals.
  • Strong experimental judgment, including upfront ablations, honest baselines, and distinguishing real effects from noise.
  • Strong Python and production experience with PyTorch or JAX; working knowledge of SFT, DPO, PPO/GRPO, and reinforcement learning with verifiable rewards.
  • Experience setting technical direction, distributed data processing, and large evaluation or training jobs using technologies such as Ray, Spark, or Kubernetes on AWS or GCP.
  • Clear written communication and the ability to present results to researchers and non-specialists.
  • Daily use of LLM coding tools such as Claude Code, Cursor, or Copilot, with critical review of their output, is required.
  • PhD or Master's degree in AI, machine learning, computer science, statistics, or a closely related field; exceptional equivalent research experience may be considered.

Nice to have

  • Frontier AI lab or top industry research group experience in post-training data, evaluations, or reward modeling.
  • Contributions to a public benchmark or dataset used by the community.
  • First-author papers at NeurIPS, ICML, ICLR, ACL, EMNLP, or similar venues.
  • Experience with RL environments and verifier design for agentic tasks, data valuation or attribution, and STEM domains such as mathematics, physics, chemistry, or biology.
  • Experience managing technical leads or managers, running concurrent programs, or directing expert networks through specifications and rubrics.

Culture & Benefits

  • Work directly with leading AI labs and enterprises on post-training, evaluation, synthetic data, and advanced AI systems.
  • Operate with high autonomy, rapid iteration, startup speed, and meaningful commercial impact.
  • Contribute to openly shared research, datasets, benchmarks, and publications at venues such as ICLR, ICML, and NeurIPS.
  • Collaborate with colleagues with experience at Google, Meta, Amazon, and other leading technology companies.
  • Work in an AI-forward, client-first environment focused on building advanced AI capabilities.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →