4 часа назад
AI Engineer (Evaluation)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
AI Engineer (Evaluation): Designing and implementing benchmarks to measure frontier AI model performance with an accent on model behavior analysis and failure investigation. Focus on building industry-leading evaluation methodologies and publishing research that shapes the future of AI development.
Location: Must be based in or willing to relocate to San Francisco, USA
Company
is a high-growth AI product lab and the team behind DesignArena, a leading benchmark platform for frontier AI models backed by top-tier VCs.
What you will do
- Define how frontier AI models are measured by designing new benchmarks and evaluation methodologies.
- Run experiments and analyze model behavior to identify emerging capabilities and failure points.
- Build evaluation tools that serve as trusted signals for the industry and frontier labs.
- Publish research and technical reports that influence the field of AI evaluation.
- Collaborate on industry-leading benchmarks that are referenced by top AI researchers and leaders.
Requirements
- Strong STEM background in Computer Science, Data Science, Statistics, Math, Engineering, or Physics.
- Deep curiosity about frontier AI models and a drive to understand model behavior.
- Ability to work onsite in San Francisco, Levi’s Plaza.
- Visa sponsorship and relocation support are available for qualified candidates.
- Fearless, hands-on approach to solving complex technical challenges.
Culture & Benefits
- Competitive salary and meaningful equity package.
- Work schedule: Sunday through Friday.
- Opportunity to work at a fast-growing, talent-dense startup.
- Direct impact on the evaluation standards used by top frontier model providers.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 часа назад
AI Engineer (MedTech)
120 000 - 210 000$
7 часов назад
AI Engineer (Applied AI)
100 000 - 300 000$
5 дней назад
Research Engineer (AI)
200 000 - 350 000$
7 часов назад
Applied AI Research Engineer (AI)
6 часов назад
ML Engineer (AI)
100 000 - 550 000$
7 часов назад
AI Engineer (Atlas)
100 000 - 300 000$