Policy Design Manager (AI)

TL;DR

Policy Design Manager (AI): Leading the development of usage policies and safety interventions for AI products with an accent on age-appropriate design and youth safety. Focus on building evaluation frameworks, conducting content classification research, and collaborating with cross-functional teams to ensure safety at scale.

Location: Must be based in or able to commute to San Francisco, CA or New York City, NY (Hybrid: min 25% in-office)

Salary: $245,000 – $285,000 USD

Company

Anthropic is an AI safety and research company dedicated to building reliable, interpretable, and steerable AI systems that are beneficial to society.

What you will do

• Draft usage policies governing responsible AI model deployment for emerging capabilities.
• Design evaluation frameworks to test model performance regarding safety and age-appropriate content.
• Review flagged content to drive enforcement and systematic policy improvements.
• Advise cross-functional teams on age assurance approaches and content classification frameworks.
• Collaborate with engineering and product teams to mitigate safety risks and design beneficial interventions.
• Educate internal stakeholders on evolving AI policy norms and regulatory standards.

Requirements

• Must be located in San Francisco, CA or New York City, NY.
• Proven experience in child safety, youth online safety, age assurance, or content classification.
• Ability to bridge technical requirements with complex policy discussions.
• Experience aligning decisions across diverse stakeholders like Product, Legal, and Engineering.
• Bachelor's degree in a related field or equivalent practical experience.
• Deep understanding of the risks and benefits of generative AI and content moderation challenges.

Nice to have

• Advanced degree in developmental psychology, child development, or education.
• Direct experience with generative AI products and prompt engineering for policy evaluation.
• Experience navigating regulatory requirements like age-appropriate design codes.

Culture & Benefits

• Competitive compensation with equity and benefits packages.
• Collaborative environment focused on long-term AI safety research.
• Flexible working hours to support work-life balance.
• Generous vacation and parental leave policies.
• Support for visa sponsorship where applicable.