Назад
48 минут назад

Model Policy Manager (Emerging AI Misuse)

207 000 - 335 000$
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Релокация
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Model Policy Manager (Emerging AI Misuse) (AI Safety/Model Policy): Building threat models, behavioral policies, safeguards, and evaluations for emerging misuse of increasingly capable AI systems with an accent on dual-use risks, empirical evidence, and model behavior boundaries. Focus on assessing how AI changes harmful capabilities, analyzing evaluation and deployment data, and translating technical uncertainty into measurable refusal and assistance criteria.

Location: San Francisco, United States. Hybrid schedule with three days per week in the office and optional work from home on Thursdays and Fridays. Relocation support is offered.

Salary: $207K–$335K plus equity.

Company

OpenAI is an AI research and deployment company developing general-purpose artificial intelligence and focused on safe deployment.

What you will do

  • Build and update threat models for emerging misuse in digital and physical settings, including conventional weapons, AI-enabled robotics, fraud, impersonation, and scalable abuse.
  • Assess what people could plausibly do with AI, including the expertise and resources required and how AI changes those barriers.
  • Define when models should help, limit assistance, or refuse in dual-use situations.
  • Convert safety judgments and threat models into policy instructions, training examples, evaluation scenarios, and grading guidance.
  • Analyze model outputs, red-team findings, deployment data, gold sets, evaluation results, and training data to identify misuse risks, inconsistent labels, failure patterns, and data-quality issues.
  • Partner with research, engineering, security, and product teams on model training, deployment decisions, monitoring, and safeguards.

Requirements

  • Hands-on experience building, testing, or assessing dual-use technologies, or a track record of threat modeling grounded in real-world system use and misuse.
  • Deep practical experience in one relevant domain and judgment about when to involve experts from other domains.
  • Ability to assess whether a capability demonstrated in testing materially changes what someone could do outside the test.
  • Ability to translate technical evidence and uncertainty into clear policy boundaries and measurable evaluation criteria.
  • Experience analyzing gold sets, evaluation results, and training data, including inconsistent human labels and annotator disagreement.
  • Comfort working hands-on with model data and evaluation results, inspecting examples, analyzing failure patterns, assessing data quality, and distinguishing policy failures from grader, model, or system failures.
  • Ability to use empirical evidence to develop and refine safety policies and safeguards.
  • Ability to work across disciplines and revise judgment as capabilities and evidence change.
  • Comfort working in a fast-paced, collaborative research environment with shifting priorities.

Culture & Benefits

  • Hybrid work with three office days per week and optional remote work on Thursdays and Fridays.
  • Relocation support is available.
  • Equity is included in the compensation package.
  • Work alongside research, engineering, security, and product disciplines on AI safety and deployment.
  • OpenAI is an equal opportunity employer and provides reasonable accommodations for applicants with disabilities.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →