Назад
Company hidden
5 дней назад

Senior Software Engineer (AI Coding Agents)

100 - 200$
Формат работы
remote (Global)
Тип работы
project
Грейд
senior
Английский
b2
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Software Engineer (AI Coding Agents): Evaluating end-to-end interactions with modern AI coding agents such as OpenAI Codex, Claude Code, and Cursor with an accent on engineering judgment, response quality, and useful explanations. Focus on assessing reasoning, distinguishing response quality levels, and writing rigorous feedback on whether interactions build or erode developer trust.

Location: Remote, worldwide; eligibility may vary because some regions may not be supported by the client.

Rate: $100–$200/hour depending on experience and location; 10–20 hours/week.

Company

hirify.global provides engineering evaluation projects for modern AI coding agents and software development workflows.

What you will do

  • Evaluate AI-generated coding interactions end to end, including whether responses are useful, correct at a high level, and aligned with strong engineering judgment.
  • Assess the quality of model explanations, preambles, reasoning, and user guidance rather than reviewing syntax or every line of code.
  • Distinguish levels of response quality and help define what excellent interactions look like for tools such as Cursor, OpenAI Codex, and Claude Code.
  • Write clear, direct, and opinionated feedback on what worked, what failed, and what felt misleading or off.
  • Judge whether agent interactions build or erode trust and reflect how experienced engineers communicate.

Requirements

  • Senior, Staff, or Principal-level engineering experience, or equivalent experience.
  • Strong background in TypeScript/JavaScript or Python.
  • Hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.
  • Deep familiarity with modern AI-assisted development workflows.
  • Ability to evaluate code without executing it or reviewing every line.
  • Strong written and spoken English at B2 level or above is required for detailed written feedback and short video explanations.
  • Ability to make subjective but rigorous judgments and explain them clearly.
  • Comfort giving direct, opinionated feedback and maintaining a high bar for engineering quality.
  • Prior exposure to prompt design or evaluation workflows, plus experience mentoring senior engineers or defining engineering standards.

Culture & Benefits

  • Contract engagement with flexible hours of 10–20 hours per week.
  • Projects are ongoing, typically lasting from about two weeks to a few months.
  • Successful evaluators may receive new projects.
  • Start as soon as the take-home exercise is cleared and a project has an open seat.

Hiring process

  • Complete one take-home evaluation exercise with a recorded Loom walkthrough.
  • No interview is required.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →