Назад
Company hidden
8 дней назад

Trust & Safety Lead, Education (AI)

150 000 - 180 000$
Формат работы
remote
Тип работы
fulltime
Грейд
lead
Английский
b2
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Trust & Safety Lead, Education (AI): Building trust and safety systems, policies, and incident-response practices for an AI education platform used by students and educators with an accent on child safety, moderation, and responsible AI. Focus on designing harm taxonomies and detection requirements, leading high-stakes incidents, and translating safety patterns into product and partner processes.

Location: Remote

Salary: $150K–$180K per year

Company

hirify.global is a technology nonprofit helping educators and students become critical consumers and creators of AI through an open-source, community-driven platform for building custom AI apps. More than 100,000 educators have published apps on hirify.global.

What you will do

  • Own platform safety decisions, including live incidents, moderation escalations, account suspensions, app takedowns, school notifications, and required reporting.
  • Review flagged content, investigate missed misuse, conduct red teaming, stress-test features, and build a tester community.
  • Define a hirify.global-specific harm taxonomy, labeling guidelines, detection requirements, labeled datasets, and success metrics for automated safety systems.
  • Lead incident response from triage and investigation through school communication, reporting, and post-incident review; improve intake and escalation paths with Support.
  • Write and maintain safety and moderation policies, review safety at product launch, and collaborate with privacy, security, product, engineering, learning engineering, and partnerships.
  • Build training, reporting, and operational resources for school and district partners; report incident trends, response times, policy coverage, and roadmap input to leadership.

Requirements

  • 5+ years of experience in trust and safety, including real-time decision-making on high-stakes escalations.
  • Experience handling safety issues involving young people, such as self-harm or abuse disclosures, inappropriate contact, CSAM reporting, or similar matters.
  • Ability to define labeling guidelines, specify what filters should detect, and evaluate detection performance while working effectively with engineering.
  • Experience building operational systems such as intake forms, triage rubrics, runbooks, training materials, and dashboards.
  • Ability to write principled, practical policies that frontline teams can apply consistently.
  • Strong judgment, communication, composure, thoroughness, and ability to explain decisions and escalate appropriately.
  • Ability to communicate with school leaders, engineers, and learning partners asynchronously and remotely.
  • Commitment to student wellbeing, equity, access, and safe AI in education.

Nice to have

  • Hands-on experience finding failures in generative AI tools, AI red teaming, evaluations, or adversarial testing.
  • Experience with proactive investigations or abuse hunting.
  • Experience with user-generated content or creator platforms, including app review, UGC moderation, or marketplace integrity.
  • Familiarity with FERPA, COPPA, state student data privacy laws, mandated reporting, or other student privacy and child safety frameworks.
  • Classroom, school leadership, counseling, or edtech experience.
  • Experience building trust and safety operations from scratch at a startup or nonprofit.

Culture & Benefits

  • Remote-first work with autonomy and a collaborative culture.
  • Approximately half the role is proactive review, hunting, and red teaming, with protected time for this work; the other half covers incidents, policy, and schools.
  • Primary escalation responsibility for urgent safety issues, with backup coverage; the role may involve disturbing material, including content involving harm to children.
  • Work with student data under policies aligned with school and district agreements.
  • Healthcare is covered 100% for the employee and 80% for dependents; dental and vision are covered 100% for the employee and dependents.
  • Retirement benefits, Life/AD&D, monthly wellness stipend, home office budget, laptop, generous time off, and professional growth opportunities.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →