Назад
8 дней назад

Staff Software Engineer - AI Gateway

190 000 - 261 250$
Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Staff Software Engineer - AI Gateway (AI/Scala/Go): Building the control plane and routing layer for AI requests across partner and self-hosted models, agents, coding assistants, and MCP servers with an accent on reliability, latency, cost, and inline guardrails. Focus on improving distributed AI workloads, routing requests across quality and availability constraints, and delivering developer-facing AI infrastructure.

Location: New York, United States

Salary: $190,000–$261,250 USD per year

Company

Databricks is a Data and AI company building and operating a unified data and AI infrastructure platform used by more than 20,000 organizations worldwide.

What you will do

  • Build the routing layer that selects the right model for each request based on quality, cost, latency, availability, and remaining budget.
  • Build the Unity AI Gateway control plane for partner and self-hosted models, agents, coding assistants, and MCP servers.
  • Improve reliability, latency, and efficiency of distributed AI workloads.
  • Collaborate with research, platform, infrastructure, and AI/ML teams on end-to-end experiences.
  • Shape how developers and data scientists build and interact with AI on Databricks.

Requirements

  • 8+ years of experience in backend or infrastructure engineering.
  • Strong programming skills in Scala or Go.
  • Experience with distributed systems, high-throughput APIs, or cloud-native infrastructure.
  • Familiarity with service-oriented architecture, deployment pipelines, and system observability.
  • Strong product and ownership mindset, with focus on building the right solution.

Nice to have

  • Experience with real-time serving, AI infrastructure, or GPU orchestration.
  • Exposure to Bedrock, Vertex AI, or Azure ML.
  • Experience building developer platforms or internal tools supporting AI workflows.

Culture & Benefits

  • Comprehensive benefits and perks, with details varying by region.
  • Commitment to a diverse and inclusive culture and equal employment opportunity.
  • Compensation may also include an annual performance bonus, equity, and regional benefits.
  • Access to export-controlled technology or source code may require a U.S. government license; Databricks may decline to proceed with an applicant on this basis.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →