1 день назад
Post-Training Engineer (AI)
300 000 - 350 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Post-Training Engineer (AI): Shipping production-grade post-trained and fine-tuned language models for enterprise customers with an accent on evaluation design, data curation, regression mitigation, and cost- and privacy-aware deployment. Focus on building bespoke eval suites, calibrating LLM judges against domain experts, managing production data flywheels, and translating enterprise requirements into reliable model behavior.
Location: Mountain View, CA preferred or San Francisco, CA onsite; remote considered
Base salary: $300,000–$350,000 USD per year, plus a 25% performance-based bonus and equity.
Company
is an applied AI research lab focused on curating data and reinforcement learning environments for training and evaluating AI agents.
What you will do
- Post-train, fine-tune, and align open-weight and proprietary models for complex enterprise domains.
- Build custom evaluation suites, benchmarks, and calibrated LLM-judge workflows for subjective tasks.
- Curate production datasets using real traces, human labeling, synthetic augmentation, and strict filtering.
- Track and mitigate regression risks across model capabilities and reasoning performance.
- Work directly with product and enterprise stakeholders to translate requirements into evaluation metrics and model behavior.
- Deploy models against demanding latency, cost, privacy, and production reliability targets.
Requirements
- Experience post-training at least one LLM and deploying it to production users.
- End-to-end ownership of benchmarks, evaluation datasets, and success metrics for complex or subjective tasks.
- Strong understanding of regression risks and methods for protecting existing model capabilities.
- Experience collaborating with enterprise customers, product managers, or other non-ML stakeholders.
- Fluency with modern post-training frameworks, data-processing pipelines, and production codebases.
- Ability to own the full lifecycle from raw data and training through deployment and failure analysis.
Nice to have
- Experience post-training conversational, task-oriented, multi-turn, or tool-using agents.
- Experience building LLM judges or reward models and calibrating them against human raters.
- Experience operating production data flywheels from traces through labeling, augmentation, and retraining.
- Hands-on experience with Llama, Qwen, Mistral, or DeepSeek for cost, latency, or privacy optimization.
- Forward-deployed engineering, founder, or early-stage startup experience.
Culture & Benefits
- Health, dental, and vision coverage.
- 401(k) plan.
- Daily onsite lunch.
- Visa sponsorship and relocation support available.
- Opportunity to influence how AI agents are trained and evaluated.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
7 дней назад
Research Engineer (AI)
190 000 - 240 000$
SandboxAQ
4 дня назад
Staff Machine Learning Engineer (AI)
156 800 - 294 000$
Baseten
4 дня назад
Post-Training Research Scientist (AI)
210 000 - 285 000$
Anthropic
3 дня назад
Research Engineer Scientist (AI)
350 000 - 500 000$
Baseten
3 дня назад
Software Engineer (AI)
180 000 - 360 000$
Anthropic
3 дня назад
Research Engineer, Production Model Post Training (AI)
350 000 - 500 000$