Product Manager, Safeguards (Account Integrity & Abuse) (AI)

Location: San Francisco, California or New York City, New York; hybrid, with staff expected to work from an office at least 25% of the time

Annual salary: $385,000–$460,000 USD

Company

Anthropic develops reliable, interpretable, and steerable AI systems designed to be safe and beneficial for users and society.

What you will do

• Own the ideation, design, development, and deployment of safeguards systems and related product UX.
• Define safety-by-design approaches and downstream defenses for frontier models, Claude.ai, the first-party API, and external cloud platforms.
• Develop safety evaluations, detections, interventions, and tools to measure and mitigate deployment and user risks.
• Set product strategy, prioritize problems, define requirements, and manage technical and business tradeoffs from MVP to ideal state.
• Collaborate with policy, enforcement, research, engineering, and other cross-functional stakeholders.
• Lead the development of metrics covering system performance, risks, user impact, and blind spots.

Requirements

• Technical product management experience designing and building safety systems with policy, AI/ML research, and software engineering teams.
• Experience building product and engineering strategy across multiple cross-functional teams in rapidly changing environments.
• Demonstrated ability to design metrics, evaluate risks and system performance, and make clear tradeoffs.
• Experience planning, building, launching, and measuring new products or systems in a zero-to-one environment.
• Ability to communicate complex technical concepts clearly to non-technical audiences.
• Bachelor’s degree or equivalent combination of education, training, and experience in a relevant field.

Nice to have

• 5+ years of product management experience, including work with data, detection and interventions, infrastructure and tools, or evaluations.

Culture & Benefits

• Collaborative environment bringing together researchers, engineers, policy experts, and business leaders.
• Work focused on large-scale AI research and the development of steerable, trustworthy AI.
• Competitive compensation with optional equity donation matching.
• Generous vacation and parental leave.
• Flexible working hours and office-based collaboration.