Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Research Fellowship (AI) (AI research and evaluation): Building open benchmarks, datasets, and evaluation environments that measure frontier AI capabilities with an accent on domain-specific research, expert review, and public research artifacts. Focus on defining task specifications and rubrics, translating expert judgment into usable evaluations, and releasing lead-authored work publicly.
Location: New York City, NY (Hybrid); San Francisco, CA (Hybrid); United States (Remote). At least one day per week is spent with the research team, including in person in the San Francisco or New York offices where applicable.
Salary: $85–$165+ per hour, depending on skills, qualifications, experience, and geographic location.
Company
Snorkel AI is a frontier AI data lab building datasets, benchmarks, evaluations, and custom solutions for real-world AI systems.
What you will do
- Scope and lead a new benchmark, dataset, or evaluation environment in a domain where current evaluations are insufficient.
- Define task specifications, rubrics, and reference answers with domain experts.
- Run the expert review process and develop the research artifact.
- Release the artifact publicly as the lead author.
- Participate in weekly research meetings, share progress, receive feedback, and contribute to other projects.
Requirements
- PhD student or postdoctoral researcher with a research background relevant to AI evaluation.
- Ability to design and build open benchmarks, datasets, or environments.
- Demonstrated ability to turn research ideas into working code, datasets, tools, or other usable research artifacts.
- Ability to collaborate with domain experts outside your field and translate their judgment into specifications.
- Ability to scope a project for public release within the fellowship term.
Nice to have
- Publications at NeurIPS, ICML, ICLR, or leading venues in the relevant discipline.
- Experience with agentic evaluation, reinforcement learning environments, or LLM evaluation harnesses.
- Deep expertise in a domain where expert-level evaluation is scarce, such as science, medicine, law, finance, or engineering.
Culture & Benefits
- Research co-advisor matched to the project.
- Access to domain experts, compute, and engineering support.
- Open-source academic artifact released as part of the work.
- Access to Snorkel’s research team, other fellows, research events, and community events.
- Research communications support for sharing findings with the broader community.
- Academic affiliation is retained during the fellowship.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →