Назад
1 день назад

Model Validation Lead (Generative AI Security)

168 336 - 394 200$
Формат работы
onsite
Тип работы
fulltime
Грейд
senior/lead
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Model Validation Lead (Generative AI Security): Building an independent assurance capability for generative AI models, including adversarial evaluations, automated validation pipelines, threat models, and release gates with an accent on model safety, cybersecurity, privacy, and reproducible testing. Focus on designing attack simulations, validating safeguards and remediation, and translating probabilistic model failures into measurable risk decisions.

Location: Washington, D.C. R&D; fully in-person schedule up to 5 days a week

Salary: $168,336–$394,200 annually in Washington, DC, plus potential discretionary bonuses, incentives, and restricted stock units.

Company

TikTok USDS Joint Venture operates data privacy, cybersecurity, and trust and safety programs protecting U.S. user data, applications, algorithms, and the content ecosystem.

What you will do

  • Set the technical strategy, quality bar, roadmap, and operating model for independent generative AI safety and security assurance.
  • Build model-validation methods, tooling, test infrastructure, specialist capacity, and automated evaluation pipelines.
  • Design and execute adversarial safety evaluations covering harmful content, abuse prevention, age-appropriate protections, policy enforcement, jailbreaks, and safeguard bypasses.
  • Validate cyber threats including prompt injection, sensitive-data disclosure, insecure tool use, agent manipulation, supply-chain weaknesses, and AI-assisted attacks.
  • Lead pre-deployment and continuous assessments of foundation models, fine-tuned models, RAG systems, agents, and model-enabled products.
  • Translate failures into security, safety, privacy, and business risks; validate remediation and report coverage, unresolved risk, safeguard efficacy, and regression trends.

Requirements

  • Bachelor’s degree in Computer Science, Information Security, Artificial Intelligence, Machine Learning, Computer Engineering, or a related technical field, or equivalent practical experience.
  • 8+ years in security testing, adversarial testing, AI or machine-learning security, trust and safety engineering, red teaming, or a related discipline, including senior technical-lead experience.
  • Hands-on experience evaluating large language models or multimodal generative AI systems for adversarial behavior, misuse, safeguard bypasses, data exposure, or unsafe outputs.
  • Ability to set technical direction, lead cross-functional programs, mentor engineers, and build a capability through influence rather than formal people-management authority.
  • Experience designing repeatable test plans, adversarial datasets, automated evaluations, and measurable acceptance criteria for complex probabilistic systems.
  • Strong knowledge of application security, cloud security, offensive security, and threat modeling across product, data, identity, and tool-execution layers.
  • Proficiency in Python and at least one additional programming language, including experience building test harnesses, integrating model APIs, analyzing results, and automating validation workflows.
  • Ability to explain complex model failures and attack paths to technical and non-technical stakeholders and provide risk-appropriate remediation guidance.

Nice to have

  • Experience with jailbreak research, prompt injection, agent and tool-use security, RAG security, multimodal testing, model privacy attacks, or AI supply-chain assessment.
  • Trust and safety partnership experience translating platform or content policies into technical evaluations and abuse scenarios.
  • Penetration testing, red teaming, vulnerability research, exploit development, or adversary emulation, including AI-enabled applications.
  • Familiarity with the NIST AI Risk Management Framework, MITRE ATLAS, OWASP guidance for large language model applications, and AI governance standards.
  • Contributions to AI safety or security research through publications, open-source tooling, vulnerability disclosures, benchmarks, or recognized conference presentations.
  • Experience conducting independent technical assurance in highly regulated, privacy-sensitive, or national security-focused environments.

Culture & Benefits

  • Full-time employment with on-site presence across teams and a shift from hybrid work to fully in-person work up to five days per week.
  • Medical, dental, and vision insurance from day one, plus a 401(k) savings plan with company match.
  • Paid parental leave, short- and long-term disability coverage, life insurance, and wellbeing benefits.
  • 10 paid holidays, 10 paid sick days, and 17 days of Paid Personal Time, with accrual increasing by tenure.
  • Inclusive workplace focused on curiosity, humility, resilience, learning, and continuous iteration.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →