обновлено 2 дня назад
Senior Software Engineer (Generative AI)
137 100 - 201 600$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Software Engineer (Generative AI): Building production infrastructure for open-weight generative AI models, including real-time GPU serving, batch inference, and fine-tuning, with an accent on scalable backend systems, GPU utilization, and cost-performance optimization. Focus on designing model platforms, improving inference latency and throughput, building observability and reliability controls, and advancing agent and post-training capabilities.
Location: San Francisco, CA; Sunnyvale, CA; or Seattle, WA, United States
Salary: $137,100–$201,600, $167,800–$246,800, or $203,500–$299,300 USD annually, depending on level and work location. Equity grants are also available.
Company
operates a delivery and commerce platform and develops shared machine learning and generative AI infrastructure for , Wolt, and Deliveroo.
What you will do
- Design and lead production infrastructure that moves generative AI products, agents, automation, and personalization from prototype to production.
- Own the open-weight model serving stack, including real-time GPU endpoints, high-throughput batch inference, and SFT, DPO, and LoRA fine-tuning.
- Architect scalable systems for model serving, GPU autoscaling, batch pipelines, backend services, observability, and cost attribution.
- Improve GPU inference cost, latency, throughput, batching, utilization, reliability, fallback behavior, and operational controls.
- Build platform capabilities with production standards for monitoring, SLOs, playbooks, experimentation, and operational excellence.
- Set technical direction, mentor engineers, and collaborate with ML engineers, product engineers, data scientists, and platform teams across , Wolt, and Deliveroo.
Requirements
- Bachelor’s, master’s, or PhD in Computer Science or equivalent experience.
- 6+ years of industry software engineering experience.
- Strong backend engineering fundamentals, especially Python and distributed systems.
- Experience designing and owning production services, APIs, data pipelines, or machine learning infrastructure at scale.
- Hands-on production experience with LLM inference or fine-tuning of open-weight models, including serving performance, autoscaling, GPU utilization, or SFT, DPO, and LoRA.
- Technical leadership experience, including architecture across ambiguous areas, mentoring engineers, production operations, observability, incident response, and performance or cost optimization.
Nice to have
- Experience with vLLM, SGLang, TensorRT-LLM, distributed fine-tuning, GPU performance optimization, Kubernetes, AWS, GCP, or elastic GPU platforms.
- Experience with LLM gateways, model routing, vendor abstraction, cost attribution, developer platforms, or self-service infrastructure.
- Experience deploying AI agents or MCP servers and working with evals, LLM observability, tracing, RAG, search, or vector databases.
Culture & Benefits
- Work on a small, high-leverage generative AI platform team in a fast-moving technical area.
- Comprehensive benefits for regular employees, including medical, dental, vision, disability, and basic life insurance.
- 401(k) plan with employer matching, paid parental leave, wellness benefits, commuter benefits matching, and family-forming assistance.
- Flexible paid time off and vacation for salaried roles, plus 80 hours of paid sick time per year.
- Mental health support and 11 paid holidays.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
2 дня назад
AI Platform Engineer
130 000 - 180 000$
10 дней назад
Senior ML Infrastructure Engineer - Embodied AI Scaling Foundations
128 700 - 261 300$
13 дней назад
Software Engineer, Machine Learning Infrastructure - USDS (Machine Learning)
136 800 - 359 720$
13 дней назад
Tech Lead Machine Learning Infrastructure Engineer (Recommendations and Search)
187 040 - 438 000$
7 дней назад
Software Engineer - Machine Learning Infrastructure (AI)
129 960 - 246 240$