AI Model Assurance Analyst

Location: New York, United States; fully in-person schedule up to 5 days a week

Base salary: $98,800–$196,000 annually, plus potential discretionary bonuses, incentives, and restricted stock units.

Company

Security joint venture responsible for protecting US user data, the US content ecosystem, and trust and safety decision-making for TikTok-operated applications.

What you will do

• Manage intake, classification, evaluation, approval, and release workflows for generative AI models and features.
• Prepare decision packages, track conditional approvals, and maintain risk, safety, and strategy registries.
• Operationalize change-detection tooling and triage unnotified changes, model drift, alerts, and deviations.
• Coordinate independent validation, incident response, remediation plans, post-incident reviews, and audit evidence readiness.
• Produce recurring oversight reports covering releases, incidents, SLA breaches, validation coverage, and remediation.
• Drive cross-functional triage, program reviews, KPI reporting, evaluation refreshes, dashboard improvements, and release-pipeline automation.

Requirements

• Bachelor’s degree in a technical, policy, risk, security, statistics, public policy, trust and safety, or compliance-related field, or equivalent practical experience.
• 3+ years of experience in operations, program management, GRC, trust and safety policy operations, model risk, or model operations, including ownership of recurring workflows with hard SLAs.
• Working knowledge of generative AI or LLM systems, content moderation classifiers, trust and safety operations, model-risk management, or AI/ML evaluation.
• Ability to interpret evaluation metrics and evidence such as precision, recall, refusal rate, protected-category false positives, and red-team results.
• Experience with ticketed approval workflows, registries of record, audit evidence packages, and driving engineering, policy, legal, and security partners to decisions.
• Strong written communication for SOPs, decision memos, and oversight reports.

Nice to have

• Experience supporting third-party assessments or independent audits, including control walkthroughs and remediation planning.
• Familiarity with red teaming, adversarial test-set design, or evaluation harnesses for text, image, audio, or video generative AI systems.
• Basic Python or SQL scripting for dashboard metrics, data joins, and evaluation checks.

Culture & Benefits

• On-site collaboration focused on speed, alignment, real-time decision-making, and integrated execution.
• Medical, dental, and vision insurance from day one, plus a 401(k) plan with company match.
• Paid parental leave, disability coverage, life insurance, and wellbeing benefits.
• 10 paid holidays, 10 paid sick days, and 17 days of paid personal time with increasing accrual by tenure.
• Inclusive workplace with reasonable accommodations available during recruitment.