Safeguards Enforcement Analyst (Cybersecurity)

TL;DR

Safeguards Enforcement Analyst (Cybersecurity): Reviewing content and executing enforcement actions to mitigate the misuse of AI systems for malicious cyber operations with an accent on detecting malware development and offensive exploitation. Focus on triaging high-severity cases, providing feedback to policy teams, and partnering with Engineering to improve detection model precision.

Location: Must be based in the United States with a hybrid policy requiring at least 25% office attendance in San Francisco, New York City, or Washington, DC.

Salary: $285,000 - $330,000 USD

Company

Anthropic is an AI safety and research company dedicated to building reliable, interpretable, and steerable AI systems.

What you will do

• Review flagged content and accounts to make accurate enforcement decisions based on usage policies.
• Detect and mitigate potential misuse of AI systems for cyberattacks, malware creation, and exploitation.
• Triage and escalate novel or high-severity cases to relevant stakeholders.
• Provide detailed feedback to the policy design team regarding policy gaps identified during enforcement.
• Collaborate with Engineering and Data Science teams to improve detection model precision and recall.
• Maintain up-to-date knowledge of emerging threat actor tactics and AI policy enforcement best practices.

Requirements

• Must be based in the United States and able to work in a hybrid capacity.
• Experience in cybersecurity, including offensive techniques, malware analysis, or vulnerability research.
• Experience performing content review, abuse investigations, or policy enforcement at scale.
• Proficiency in SQL and/or Python for data analysis and threat detection.
• Experience identifying emerging risks and communicating findings to cross-functional teams.
• Experience working with generative AI products, including prompt engineering for enforcement.

Nice to have

• Experience in trust & safety or threat intelligence within a technology or AI company.
• Understanding of large language models and their potential misuse for cyber operations.
• Experience working with government agencies or regulated environments.

Culture & Benefits

• Competitive compensation and benefits package.
• Generous vacation and parental leave policies.
• Flexible working hours to support work-life balance.
• Collaborative research-driven environment with frequent team discussions.
• Office space designed for collaboration and team interaction.