Назад
Company hidden
6 часов назад

Staff Backend Engineer (AI)

250 000 - 350 000$
Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Staff Backend Engineer (AI): Building and operating core components of an open-source LLM gateway at 1B+ requests per month with an accent on routing, authentication, caching, guardrails, spend tracking, and observability. Focus on eliminating distributed-systems failures, improving reliability through code, migrating performance-critical paths from Python to Rust, and protecting LLM APIs, MCP servers, and agents.

Location: Onsite in San Francisco, United States

Salary: $250,000–$350,000 base plus equity

Company

hirify.global provides an open-source Python SDK and proxy server for calling 100+ LLM APIs in the OpenAI format, used by major companies and supported by 60K+ GitHub stars.

What you will do

  • Own core proxy components from design through production, including incident response.
  • Identify and eliminate race conditions, stale cache state across replicas, silently swallowed errors, and other classes of production bugs.
  • Build and operate gateway guardrails that log and trace policy checks and block common attacks on LLM APIs, MCP servers, and agents.
  • Maintain accurate, low-overhead observability integrations with Datadog, Splunk, Prometheus, and OpenTelemetry at 1B+ requests per month.
  • Migrate performance-critical paths from Python to Rust without changing behavior.
  • Set a high standard for code review, testing, debugging, and backend delivery across the team.

Requirements

  • 5+ years building production backend systems, including mission-critical systems such as payments, gateways, core APIs, or data stores where downtime affects customers.
  • Strong Python and experience with async or high-throughput services such as asyncio, FastAPI, or similar.
  • Demonstrated ability to improve production reliability through refactoring, re-architecture, migration, or permanent root-cause fixes.
  • Excellent debugging skills across services, databases including Postgres and Redis, and distributed systems.
  • High ownership of customer impact and production outcomes.
  • BS/MS in Computer Science or a related field, or equivalent evidence of exceptional ability.

Nice to have

  • Production experience with Rust, Go, or C++.
  • Experience at a fast-growing startup with a large, real-world codebase.
  • Experience with LLM APIs, proxies, or API gateways.
  • Open-source contributions.

Culture & Benefits

  • Onsite work in San Francisco on a small, senior-leaning team of about 20 people.
  • Ownership of core systems used in the critical path by major companies.
  • Health, dental, and vision benefits.
  • Base salary of $250,000–$350,000 plus equity.
  • Profitable and fast-growing company backed by Kleiner Perkins.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →