Назад
5 дней назад

Technical Program Manager, External Evaluators (AI)

290 000 - 365 000$
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Technical Program Manager, External Evaluators (AI): Building and scaling an external evaluator program for frontier AI models with an accent on evaluator partnerships, secure model access, and cross-functional program delivery. Focus on designing access controls and tooling, translating evaluation findings into research and engineering work, and managing the path from contracting through published reports.

Location: San Francisco, CA or New York City, NY; hybrid policy requires staff to be in one of the offices at least 25% of the time

Annual salary: $290,000–$365,000 USD

Company

Anthropic is a public benefit corporation building reliable, interpretable, and steerable AI systems designed to be safe and beneficial.

What you will do

  • Own the external evaluator program, including partner relationships and the pipeline of future evaluator organizations.
  • Manage evaluators from initial conversations through scoping, contracting, onboarding, access, review, and publication.
  • Define evaluator engagement stages, information-access policies, permissions, environments, monitoring, and technical controls with Security, IT, infrastructure, Research, Legal, and other teams.
  • Scope evaluations with researchers and engineers, translating questions about training, monitoring, and alignment into requirements for model access, data, tooling, compute, and capacity.
  • Review evaluator reports against timelines and redaction criteria while preserving evaluators’ ability to publish independent conclusions.
  • Build and improve program tooling, track findings through research and engineering responses, communicate progress, and iterate through feedback and retrospectives.

Requirements

  • Experience leading complex technical programs with engineering or research teams from ambiguous goals through delivery.
  • Experience managing relationships with external organizations, including scoping work, navigating contracting, setting expectations, and resolving disagreements.
  • Strong program management skills covering planning, milestones, dependencies, risk management, and multiple concurrent workstreams.
  • Technical fluency in how frontier AI models are trained, evaluated, and monitored, sufficient to define requirements, identify risks, and challenge tradeoffs with researchers and engineers.
  • Sound judgment and discretion when handling confidential and sensitive information.
  • Bachelor’s degree or an equivalent combination of education, training, and experience; the field of study must be relevant to the role through coursework, training, or professional experience.
  • Required years of experience correlate with the internal job level requirements for the position.

Culture & Benefits

  • Collaborative, cohesive research environment focused on large-scale AI research and trustworthy, steerable systems.
  • Flexible working hours, generous vacation and parental leave, competitive benefits, optional equity donation matching, and office collaboration space.
  • Visa sponsorship is available, although sponsorship cannot be guaranteed for every role and candidate; immigration lawyer support is provided.
  • Communication skills and diverse perspectives are valued across research and company collaboration.
  • Candidate AI usage is governed by Anthropic’s application-process policy.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →