Чётко очерченная роль уровня Staff в сильной компании в сфере AI-инфраструктуры с серьёзной ответственностью за высоконагруженный продукт; главный компромисс - работа только из офиса в Нью-Йорке.
Только офис
На волне AI
Современный стек
Понятная роль
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Staff Software Engineer - AI Gateway (AI/Scala/Go): Building the control plane and routing layer for AI requests across partner and self-hosted models, agents, coding assistants, and MCP servers with an accent on reliability, latency, cost, and inline guardrails. Focus on improving distributed AI workloads, routing requests across quality and availability constraints, and delivering developer-facing AI infrastructure.
Location: New York, United States
Salary: $190,000–$261,250 USD per year
Company
Databricks is a Data and AI company building and operating a unified data and AI infrastructure platform used by more than 20,000 organizations worldwide.
What you will do
Build the routing layer that selects the right model for each request based on quality, cost, latency, availability, and remaining budget.
Build the Unity AI Gateway control plane for partner and self-hosted models, agents, coding assistants, and MCP servers.
Improve reliability, latency, and efficiency of distributed AI workloads.
Collaborate with research, platform, infrastructure, and AI/ML teams on end-to-end experiences.
Shape how developers and data scientists build and interact with AI on Databricks.
Requirements
8+ years of experience in backend or infrastructure engineering.
Strong programming skills in Scala or Go.
Experience with distributed systems, high-throughput APIs, or cloud-native infrastructure.
Familiarity with service-oriented architecture, deployment pipelines, and system observability.
Strong product and ownership mindset, with focus on building the right solution.
Nice to have
Experience with real-time serving, AI infrastructure, or GPU orchestration.
Exposure to Bedrock, Vertex AI, or Azure ML.
Experience building developer platforms or internal tools supporting AI workflows.
Culture & Benefits
Comprehensive benefits and perks, with details varying by region.
Commitment to a diverse and inclusive culture and equal employment opportunity.
Compensation may also include an annual performance bonus, equity, and regional benefits.
Access to export-controlled technology or source code may require a U.S. government license; Databricks may decline to proceed with an applicant on this basis.
Будьте осторожны
Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →