3 дня назад
Research Engineer (QC Automation)
150 000 - 250 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Research Engineer (QC Automation) (AI training data): Building scalable quality-control and validation systems for reinforcement-learning environments and post-training AI datasets with an accent on human-judgment-based evaluation, data quality standards, and agent-output grading. Focus on designing experiments and metrics, diagnosing agent failure modes, and building auditing, sampling, and rule-based or model-assisted validation pipelines.
Location: On-site in San Francisco, California for U.S.-based candidates; on-site in Singapore for Southeast Asia-based candidates. Fully remote independent contractor arrangements are considered for candidates based elsewhere, particularly in Europe.
Salary: $150,000–$250,000 USD annually
Company
is an early-stage company building infrastructure for reinforcement-learning environments and post-training AI datasets.
What you will do
- Automate quality control for training data produced through the platform infrastructure.
- Define and enforce end-to-end quality standards for AI training data.
- Design experiments, benchmarks, rubrics, and metrics to evaluate agent outputs across diverse tasks.
- Build auditing systems with sampling strategies and rule-based or model-assisted validation pipelines.
- Partner with data vendors to diagnose quality issues and agent failure modes, then improve data-generation processes.
- Integrate quality-control insights into infrastructure tools and the vendor portal to reduce anomalies and edge cases.
Requirements
- 2–4 years of experience in engineering or research roles, ideally in quality-control automation or data quality.
- Proficiency in Python, Docker, and Linux environments.
- Experience building scalable data-validation pipelines and automated QA/QC systems end-to-end without a prescribed roadmap.
- Experience with benchmarks and evaluations for reinforcement-learning training data, including realistic tasks, reliable rubrics, and useful trajectories.
- Strong knowledge of statistics and experience designing metrics and QA/QC processes.
- Strong written and verbal communication skills for cross-timezone collaboration, plus the ability to work autonomously in a fast-paced environment.
Culture & Benefits
- Work on a critical quality function within an approximately 15-person engineering team.
- Collaboration with data vendors and infrastructure teams.
- Early-stage environment emphasizing curiosity, intellectual range, and autonomy.
- Visa sponsorship is available for qualifying candidates.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
3 дня назад
Product Solutions Engineer (AI)
125 000 - 140 000$
6 дней назад
Software Engineer, Applied AI (AI)
150 000 - 170 000$
4 дня назад
AI Software Engineer
120 000 - 150 000$
4 дня назад
Backend or Fullstack Developer (AI)
140 000 - 200 000$
33 минуты назад
System Software Engineer (AI)
100 000 - 180 000CAD
Cohere
3 дня назад
Software Engineer (Applied AI)
120 000 - 275 000$