13 дней назад
Senior Staff Software Engineer (AI/ML)
208 000 - 315 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Staff Software Engineer (AI/ML): Building efficient agentic evaluations, model-routing systems, fine-tuned small models, predictive difficulty models, and rigorous measurement infrastructure for frontier AI data with an accent on statistical experimentation, production ML, and cost-efficient evaluation. Focus on reducing long-horizon evaluation cost, validating non-deterministic systems, and turning research prototypes into reusable production components.
Location: San Francisco, CA (Hybrid)
Salary: $208,000–$315,000 USD per year
Company
Snorkel AI develops technology that helps enterprises transform expert knowledge and proprietary data into specialized, production-ready AI systems.
What you will do
- Develop efficient agentic evaluations using adaptive sampling, early stopping, model cascades, caching, and cost-aware gating.
- Build AI model-routing systems with fallbacks, monitoring, and cost attribution.
- Fine-tune and serve open-weight models using parameter-efficient methods such as LoRA.
- Build predictive models for estimating task difficulty before frontier-model rollouts.
- Create golden datasets and measure the accuracy and calibration of LLM-as-judge systems.
- Turn research prototypes into reusable, configurable components for engineers and researchers.
Requirements
- 5+ years of experience building production ML or software systems, with end-to-end ownership from prototype to production.
- Hands-on experience running LLM or ML workloads in production and reasoning about non-deterministic systems.
- Strong knowledge of statistics and experimentation, including experiment design, hypothesis testing, sampling, and confidence intervals.
- Strong Python and software engineering fundamentals, including testing, code review, and system design.
- Experience designing evaluations and interpreting results rigorously.
- Clear communication with researchers, engineers, and business partners.
Nice to have
- Experience fine-tuning and serving open-weight models.
- Experience building LLM evaluation platforms, experimentation platforms, model gateways, or routing systems.
- Experience with agentic workloads, benchmarks, or reinforcement learning environments.
- Research-to-production experience demonstrated through publications, open-source work, or shipped research-driven features.
- MS or PhD in Computer Science, Machine Learning, Statistics, or a related field.
Culture & Benefits
- Work on frontier AI measurement and evaluation problems.
- Help define ML engineering practices and grow an emerging ML and Research Engineering team.
- Meaningful influence over technical priorities and strategic decisions.
- Opportunities for technical growth, leadership development, and cross-functional learning.
- Join a well-funded company scaling its engineering and research teams.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
Anthropic
1 день назад
Applied AI Architect, Public Sector
240 000 - 315 000$
13 дней назад
Senior Software Engineer (AI Infrastructure)
260 000 - 285 000$
14 дней назад
AI Engineer
160 650 - 217 350$
13 дней назад
Senior Staff Software Engineer (AI)
220 500 - 298 000$
14 дней назад
Senior Data Scientist (AI)
13 дней назад
Senior Software Engineer (AI Tools)
225 000 - 250 000$