Technical Program Manager (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
TL;DR
Technical Program Manager (AI): Designing and delivering high-quality data proposals and benchmarks for AI labs with an accent on frontier-grade reasoning, coding, and multi-modal evaluation. Focus on building rigorous QC structures, managing subject-matter experts, and converting pilot projects into production engagements.
Location: Remote; must be based in Latam (Argentina, Chile, Ecuador, Mexico, Peru, Uruguay) or the US
Company
is a specialized team focusing on the Human Data Division for AI labs, creating high-difficulty benchmarks and expert-verified ground truth data.
What you will do
- Design and build frontier-grade sample packages and benchmarks across reasoning, coding, agents, and multi-modal tasks.
- Study public benchmarks and eval targets to create proposals and sample packages that win new engagements from AI labs.
- Recruit, brief, and calibrate a pool of subject-matter experts across STEM and coding to maintain a high quality bar.
- Establish rigorous QC structures, including calibration layers, severity-weighted rubrics, and deterministic verifiers.
- Own the pilot delivery process end-to-end, from scoping and SOW to production and final delivery.
- Act as the primary point of contact for lab partners, coordinating with the CEO and experts.
Requirements
- 5+ years in technical delivery, quality, or program management.
- Recent professional experience in AI/ML data, model evaluation, or benchmarking.
- Hands-on experience delivering data or evaluation work directly to AI labs or enterprise ML teams.
- Working fluency with frontier model evaluation metrics: benchmarks, rubrics, pass rates, and headroom.
- Proven leadership experience in recruiting and calibrating expert pools or vendors.
- Fluent English proficiency.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →