13 часов назад
Research Engineer (AI)
200 000 - 350 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Research Engineer (AI): Building evaluation, tracing, replay, labeling, optimization, and fine-tuning systems that make enterprise AI agents measurably more reliable and capable with an accent on production feedback loops, agent behavior, and specialist model adaptation. Focus on designing eval harnesses, improving prompts and routing, fine-tuning models, and shipping research-driven improvements for high-volume real-world tasks.
Location: San Francisco, on-site
Salary: $200,000–$350,000 per year, plus equity
Company
builds AI agents that autonomously resolve enterprise IT, HR, Legal, Finance, Security, and Operations tasks through Slack and Teams.
What you will do
- Build the evaluation and optimization loop for core AI agents using production usage to improve quality, latency, and reliability.
- Improve agent behavior through prompts, programs, routing logic, constraints, and model adaptations, including DSPy and GEPA where useful.
- Fine-tune, adapt, and evaluate specialist models for repeatable, high-volume agent tasks.
- Develop production traces, offline replay, labeling workflows, evaluation harnesses, and optimization loops.
- Work across agent orchestration, evaluation infrastructure, product workflows, and customer-facing AI behavior.
- Partner with product, engineering, and leadership to ship measurable improvements quickly.
Requirements
- Strong background in software engineering, machine learning, or applied AI, demonstrated through an advanced degree or equivalent production experience.
- Strong software engineering fundamentals and sound judgment for designing, building, and debugging complex systems.
- Experience building AI evaluations, including datasets, judges, metrics, offline replay, tracing, or regression testing.
- Practical understanding of model adaptation and post-training methods such as LoRA/QLoRA, SFT, distillation, preference optimization, reward modeling, DPO/GRPO, and reinforcement learning from verifiable feedback.
- Ability to own projects end to end, move quickly from real usage, and deliver measurable improvements.
- Interest in current research on models, agent architectures, evaluations, post-training, and optimization.
Culture & Benefits
- High-agency, action-oriented environment with a strong focus on impact and craftsmanship.
- Competitive compensation with comprehensive health, dental, and vision insurance.
- Unlimited paid time off and 401(k).
- Equity and daily meals provided in the office.
- Opportunities to grow with the company as it scales.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
Agent Research Engineer (AI)
160 000 - 320 000$
4 дня назад
Software Engineer (AI)
100 000 - 250 000$
3 дня назад
AI Systems Engineer (AI)
150 000 - 225 000$
4 дня назад
Customer Engineer (ML/AI)
170 000 - 199 000$
3 дня назад
Research Engineer, Asta (AI)
118 800 - 178 200$
2 дня назад