9 дней назад
Technical Program Manager (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Technical Program Manager (AI): Owning end-to-end data and evaluation programs for frontier AI labs, vendors, and internal teams with an accent on translating ambiguous technical requirements into executable specifications and maintaining reliable delivery pipelines. Focus on measuring dataset quality, coordinating vendors and cross-functional dependencies, and improving tooling, automation, and workflows for evaluating LLMs and agents.
Location: On-site in San Francisco or Singapore, with remote work available for candidates who can maintain 70–80% working-hours overlap with either San Francisco or Singapore time zones. Relocation and visa support are available for strong full-time candidates moving to the US or Singapore.
Company
builds infrastructure for producing reinforcement-learning training data and evaluations for frontier AI agents, and operates a marketplace connecting this data with frontier labs.
What you will do
- Own data and evaluation programs from scoping and requirements gathering through production, quality assurance, delivery, and retrospectives.
- Translate ambiguous requests from AI labs and internal teams into specifications covering milestones, owners, dependencies, and acceptance criteria.
- Maintain data-quality procedures using quantitative metrics and qualitative inspection, including task coverage, difficulty, and reward distributions.
- Manage delivery pipelines and external vendors throughout the production lifecycle.
- Improve workflows, documentation, automation, and cross-functional handoffs for data production and evaluation.
- Partner with research, platform, and marketplace teams to turn feedback into product improvements.
Requirements
- Experience owning complex technical programs in AI/ML, data operations, support engineering, applied research, forward-deployed engineering, or a similar cross-functional environment.
- Strong quantitative and qualitative judgment for assessing whether datasets and evaluations are useful, reliable, and representative.
- Experience maintaining and improving complex project-delivery or data processes.
- Ability to structure ambiguous problems, adapt as requirements change, and make sound tradeoffs.
- Strong written and verbal communication skills, including the ability to turn complex technical information into clear decisions, owners, and next steps.
- Ability to work on-site in San Francisco or Singapore, or remotely with 70–80% time-zone overlap with one of those locations.
Nice to have
- Experience with RLHF, reinforcement-learning environments, agent evaluations, human-in-the-loop data pipelines, annotation, or expert data collection.
- Experience supporting frontier AI labs, technical enterprise customers, or research teams with urgent requirements.
- Early-stage startup experience and the ability to work independently in a fast-paced environment.
Culture & Benefits
- Full-time role at a rapidly scaling, profitably growing AI startup with approximately 25 people.
- Competitive compensation.
- US employees receive fully covered medical, dental, and vision insurance, plus 401(k) and commuter benefits.
- Office employees receive lunch and dinner.
- Company-wide holiday break from Christmas Eve through New Year’s Day, in addition to PTO and paid holidays.
- Access to AI development tools, Equinox membership, and relocation and visa support for eligible candidates.
Hiring process
- Applications are reviewed on a rolling basis.
- Two technical interviews followed by a 2–3 day work trial.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
14 дней назад
People Strategic Programs Manager (AI)
188 000 - 235 000$
10 дней назад
Senior Manager, Finance AI Acceleration Office
153 700 - 246 200$
10 дней назад
Program Manager (AI Healthcare)
110 000 - 140 000$
10 дней назад
Staff Technical Program Manager (Release Management) (AI)
181 000 - 290 000$
11 дней назад
Sr. Principal Technical Program Manager (AI)
176 000 - 221 000$
CrowdStrike
10 дней назад
AI Operations Manager
100 000 - 155 000$