Product Manager, Safeguards Rare Harms (AI)

Location: San Francisco, CA, United States; hybrid policy requires staff to work from an office at least 25% of the time

Annual salary: $305,000–$385,000 USD

Company

Anthropic develops reliable, interpretable, and steerable AI systems designed to be safe and beneficial for users and society.

What you will do

• Own the ideation, design, development, and deployment of safeguards systems and related product UX.
• Define upstream safety-by-design approaches and downstream defenses for frontier models, Claude.ai, the first-party API, and external cloud platforms.
• Develop safety evaluations, detections, interventions, and tools to measure and mitigate deployment and user risks.
• Set product strategy, prioritize roadmaps, define MVP and ideal-state requirements, and navigate business and technical tradeoffs.
• Collaborate with policy, enforcement, research, engineering, product, and other cross-functional stakeholders.
• Lead the development of metrics covering risk, system performance, user impact, and safeguards blind spots.

Requirements

• Technical product management experience with the ability to make complex technical tradeoff decisions.
• Experience working with policy experts, AI/ML research engineers, and software engineering teams.
• Experience designing metrics to evaluate risks, system performance, and user impact.
• Experience planning, building, launching, and measuring products or systems in a zero-to-one environment.
• Ability to communicate complex technical concepts clearly to non-technical audiences.
• Bachelor’s degree or equivalent education, training, or professional experience in a relevant field.

Nice to have

• 5+ years of product management experience.
• Experience with data, detections, interventions, infrastructure, tools, and/or evaluations.
• Experience building roadmaps and delivering progress in rapidly changing environments.

Culture & Benefits

• Collaborative environment focused on large-scale AI research and trustworthy, steerable AI.
• Flexible working hours and a collaborative office environment.
• Generous vacation and parental leave.
• Competitive compensation and optional equity donation matching.
• Visa sponsorship is available, with immigration-lawyer support, although sponsorship cannot be guaranteed for every role or candidate.