2 часа назад
Research Engineer (AI)
250 000 - 300 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Research Engineer (AI): Building proprietary benchmarks, datasets, and evaluation systems for AI agents handling fraud, identity, and risk workflows with an accent on model quality, domain-specific measurement, and experimental rigor. Focus on designing offline and online evaluations, analyzing failure modes, and developing reusable quality tools for regulated and adversarial environments.
Location: San Francisco, United States; fully in-person
Base salary: $250,000–$300,000 per year, plus equity
Company
builds AI agents for high-stakes risk investigations, fraud detection, and identity reviews.
What you will do
- Build proprietary benchmarks and datasets for fraud, identity, and risk workflows.
- Design and run offline and online evaluations based on real customer tasks.
- Define quality metrics including precision, calibration, consistency, abstention, and failure handling.
- Analyze model and agent failures and convert findings into improved evaluations, datasets, and training loops.
- Build reusable evaluation tools and quality components for multiple product workflows.
- Partner with research, engineering, product, and design to improve system quality through experimentation.
Requirements
- Experience training, evaluating, or improving modern machine learning systems.
- Strong programming skills and comfort with research-heavy codebases.
- Experience building benchmarks, datasets, evaluation pipelines, or quality systems.
- Familiarity with LLMs, agent systems, retrieval, post-training, or adjacent areas.
- Ability to design clean experiments and draw reliable conclusions from noisy results.
- Interest in fraud, risk, trust and safety, compliance, or other regulated and adversarial domains.
Culture & Benefits
- Ownership, urgency, craftsmanship, spirited debate, and continuous experimentation.
- Fully in-person work in San Francisco.
- Meaningful equity and competitive compensation.
- Platinum-level medical, dental, and vision insurance.
- Unlimited PTO, sick leave, parental leave, and a 401(k) plan.
- Up to $100 per month for personal health and wellness expenses.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
6 часов назад
ML Engineer (AI)
190 000 - 320 000$
3 часа назад
Applied ML Engineer (AI)
170 000 - 280 000$
2 часа назад
Researchers (AI)
150 000 - 300 000$
4 дня назад
Research Engineer on Evaluations (AI)
190 000 - 375 000$
2 часа назад
Machine Learning Engineer (AI Safety)
160 000 - 257 000$
2 часа назад
Data Scientist
170 000 - 275 000$