обновлено 2 дня назад
Senior Security Researcher and Principal Security Researcher (Multiple Positions)
119 800 - 234 700$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Security Researcher and Principal Security Researcher (AI Evaluation and Cybersecurity): Building the evaluation backbone for agentic security and engineering workflows with an accent on benchmark design, evaluation harnesses, deterministic validation, and production telemetry. Focus on comparing models and orchestration patterns, detecting regressions and evaluator miscalibration, and integrating reproducible evidence into CI/CD release gates.
Location: Redmond, Washington, United States
Salary: USD $119,800–$234,700 per year for Security Research IC4; USD $142,800–$274,800 per year for Security Research IC5. Location-specific ranges apply in the San Francisco Bay Area and New York City metropolitan area.
Company
Microsoft Security is developing agentic engineering systems for security triage, remediation, repository readiness, and scan-to-verified-closure workflows.
What you will do
- Design and build end-to-end evaluation harnesses for agentic security and engineering workflows.
- Create versioned benchmark suites and golden datasets covering normal, edge, adversarial, failure-recovery, regression, and production-derived cases.
- Implement validators, automated graders, trace analyzers, result stores, comparison views, and workflow adapters.
- Measure task success, correctness, safety, policy compliance, latency, tool-call behavior, token usage, cost, and human-review effort.
- Integrate evaluations into engineering workflows, CI/CD, release gates, and production feedback loops.
- Partner with agent builders, product teams, security engineers, data scientists, program managers, and leadership on release and autonomy decisions.
Requirements
- Doctorate, master's degree with 3+ years of relevant experience, bachelor's degree with 4+ years of relevant experience, or equivalent experience in a related technical field.
- Production software engineering experience with developer platforms, test infrastructure, automation frameworks, data pipelines, quality systems, or reliability tooling.
- Ability to design and implement evaluation systems end to end, including task definition, dataset creation, harness implementation, scoring, analysis, and operational integration.
- Strong coding, debugging, system design, and operational excellence skills, including experience with structured data, logs, traces, metrics, APIs, and telemetry.
- Experience with LLMs, AI agents, model evaluation, prompt and tool orchestration, automated grading, or benchmark design.
- Experience with security engineering, vulnerability management, SAST/SCA, SARIF, remediation workflows, secure development lifecycle, or compliance-sensitive systems.
Culture & Benefits
- Work within Microsoft Security on systems that support safe, reliable, and efficient agentic engineering.
- Collaborate across engineering, product, security, data science, program management, and leadership functions.
- Potential eligibility for benefits and additional compensation.
- Applications are accepted on an ongoing basis until the position is filled.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
5 дней назад
AI Cybersecurity Engineer
100 000 - 120 000$
4 дня назад
Sr. Security Engineer (AI)
121 000 - 226 000$
Reddit
7 дней назад
Senior Security Engineer (AI Security)
190 800 - 267 100$
2 дня назад
Principal Active Defense Engineer (Cybersecurity)
167 200 - 300 000$
5 дней назад
Principal Cyber Security Engineer (AI)
249 000 - 348 500$
1 день назад
Principal AI Security Engineer (Cybersecurity)
170 000 - 225 000$