Назад
Company hidden
21 час назад

Backend Engineer (LLM Infrastructure)

140 000 - 225 000$
Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Backend Engineer (LLM Infrastructure) (AI): Build the services powering enterprise AI products, including an LLM gateway, retrieval and knowledge services, evaluation infrastructure, async execution, and authorization, with an accent on production async Python, distributed systems, and governed model access. Focus on designing routing and metering, hybrid search and reranking, durable agent execution, per-tenant isolation, regression evaluation, and cost accounting.

Location: Remote within the United States; must be authorized to work in the US full-time. Travel to the Seattle area is required for the final interview, with company summits twice per year.

Compensation: $140K–$225K annually, plus equity and bonus eligibility.

Company

hirify.global is a profitable public benefit corporation founded in 2024 that develops physics-informed ML and enterprise AI solutions for climate, sustainability, energy, real estate, logistics, and utilities.

What you will do

  • Own the LLM gateway, including model routing, usage metering, budgets, guardrails, and hosted or self-hosted provider adapters.
  • Develop retrieval and knowledge services with connectors, chunking, hybrid search, reranking, grounded answers, and an MCP interface.
  • Build evaluation infrastructure with confidence intervals and per-segment regression analysis.
  • Own the asynchronous framework, public API, rate-limiting algorithms, administration tools, and its evolution toward durable agent execution.
  • Design authorization across the platform, including token hierarchies, capability grammars, and tested tenant isolation.
  • Ship observability, evaluations, traces, cost accounting, and operational dashboards for every feature.

Requirements

  • 5+ years of deep production experience with asynchronous Python, including cancellation scopes, streaming lifecycles, and connection pooling.
  • Strong production experience with Postgres infrastructure, MVCC, advisory locks, vacuum discipline, Redis or Dragonfly, and distributed systems.
  • Experience designing API surfaces used by other engineers, including versioning, idempotency, error vocabularies, migrations, and documentation.
  • Depth in either LLM gateway engineering or retrieval engineering, with working credibility in the other area.
  • Practical experience with Python, FastAPI or Starlette, Pydantic, asyncpg or SQLAlchemy, Postgres with pgvector, and Redis or Dragonfly with Lua.
  • Current authorization to work full-time in the United States is required; hirify.global cannot sponsor or take over employment visa sponsorship.

Nice to have

  • Experience in energy, real estate, utilities, climate, or related industries.
  • Experience in both startup and enterprise environments.
  • Exposure to OpenTelemetry GenAI conventions, SSE, OpenAI or Anthropic APIs, job frameworks, rate-limit algorithms, and integer-cents money handling.

Culture & Benefits

  • Fully remote work culture with a cluster of teammates in Seattle.
  • Health insurance with meaningful dependent coverage.
  • Flexible paid time off.
  • Equity and bonus eligibility.
  • Work on AI transformation for critical industries and climate-related challenges.

Hiring process

  • Final interviews take place in the Seattle area, requiring travel.
  • Company summits require travel twice per year.
  • Applicants may apply to a maximum of two roles within a six-month period.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →