Назад
Company hidden
5 дней назад

Research Engineer (AI)

150 000 - 350 000$
Формат работы
remote (только USA)/onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Research Engineer (AI) (Python/RL/evaluations): Building coding and long-horizon agent evaluations, executable environments, verifiers, and RL data pipelines for frontier AI models with an accent on reward design, failure analysis, and scalable task generation. Focus on tracing model failures through outputs and harness code, distinguishing model limitations from environment or scoring problems, and validating training improvements on held-out tasks.

Location: San Francisco, United States, or remote; flexible option to work remotely or in person at the San Francisco offices. Visa sponsorship and relocation assistance are available for international candidates.

Cash compensation: $150,000–$350,000, including equity incentives.

Company

hirify.global is building an open superintelligence stack with infrastructure for compute, environments, evaluations, secure sandboxes, training, and deployment of frontier AI models.

What you will do

  • Design and build challenging evaluations for coding and long-horizon agents.
  • Build executable environments in Verifiers with realistic task setups and clear success criteria.
  • Develop and test scoring logic and verifiers while investigating reward hacking and misleading progress measures.
  • Trace model failures through outputs and harness code to distinguish model limitations from environment or scoring issues.
  • Build and scale RL data pipelines that generate and curate coding and agentic tasks.
  • Work with RL researchers to assess whether task and training-data changes improve performance on held-out tasks.

Requirements

  • Strong software engineering skills in Python and experience building data pipelines, evaluation systems, or ML workflows used by others.
  • Hands-on experience with language models or agents and an understanding of how training data and evaluation choices affect model behavior.
  • Ability to inspect complex data and model outputs, identify failure modes, and turn ambiguous quality questions into testable measurements.
  • Experience owning technical projects through experimentation, implementation, and validation while collaborating with researchers and engineers.
  • Experience building technical evaluations or agent environments, including debugging model traces, harnesses, and scoring code.

Nice to have

  • Experience with large-scale synthetic data generation, dataset curation, distributed processing, or reproducible research tooling.
  • Experience with RL or post-training data, task difficulty selection, and rollout or reward distribution analysis.
  • Contributions to Verifiers, Prime-RL, or comparable environment and evaluation frameworks.
  • Experience with model-based grading, long-horizon coding agents, or diagnosing reward exploitation.

Culture & Benefits

  • Flexible remote or in-person work arrangements.
  • Visa sponsorship and relocation assistance for international candidates.
  • Quarterly team off-sites, hackathons, conferences, and learning opportunities.
  • Work at the intersection of frontier research, real infrastructure, and open AI development.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →