Назад
Company hidden
7 часов назад

Senior Backend Engineer (AI)

200 000 - 260 000$
Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Backend Engineer (AI): Building and operating the core of an open-source AI gateway, including routing, authentication, caching, spend tracking, guardrails, and observability at 1B+ requests per month with an accent on correctness, reliability, and high-throughput performance. Focus on eliminating distributed-system failures, securing LLM APIs and agents, maintaining low-overhead observability, and migrating critical paths from Python to Rust.

Location: Onsite in San Francisco, United States

Salary: $200K–$260K base annually, plus equity

Company

hirify.global develops an open-source Python SDK and proxy server for calling 100+ LLM APIs in the OpenAI format, used by major companies and processing 1B+ requests per month.

What you will do

  • Own core proxy components end to end, from design through production and incident response.
  • Eliminate systemic failures including race conditions, stale cache state across replicas, and silently swallowed errors.
  • Build and operate guardrails that log, trace, and block common attacks on LLM APIs, MCP servers, and agents.
  • Maintain Datadog, Splunk, Prometheus, and OpenTelemetry integrations with minimal latency overhead and no memory leaks.
  • Migrate performance-critical paths from Python to Rust without changing behavior.
  • Raise engineering standards through code review, testing, and debugging.

Requirements

  • 2+ years building backend systems in production, including mission-critical systems such as payments, gateways, core APIs, or data stores.
  • Strong Python and experience with asynchronous or high-throughput services such as asyncio, FastAPI, or similar.
  • Experience improving production reliability through refactoring, re-architecture, migrations, or permanent root-cause fixes.
  • Excellent debugging skills across services, databases including Postgres and Redis, and distributed systems.
  • High ownership and responsibility for the customer impact of shipped work.
  • BS/MS in Computer Science or a related field, or equivalent evidence of exceptional ability.

Nice to have

  • Production experience with Rust, Go, or C++.
  • Experience at a fast-growing startup with a large real-world codebase.
  • Experience with LLM APIs, proxies, or API gateways.
  • Open-source contributions.

Culture & Benefits

  • Real ownership of core systems on a small, senior-leaning team of about 20 people.
  • Onsite work in San Francisco.
  • Health, dental, and vision benefits.
  • Equity and a $220K–$250K base compensation range are also stated in the role description.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →