21 час назад
Backend Engineer (LLM Infrastructure)
140 000 - 225 000$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Backend Engineer (LLM Infrastructure) (AI): Build the services powering enterprise AI products, including an LLM gateway, retrieval and knowledge services, evaluation infrastructure, async execution, and authorization, with an accent on production async Python, distributed systems, and governed model access. Focus on designing routing and metering, hybrid search and reranking, durable agent execution, per-tenant isolation, regression evaluation, and cost accounting.
Location: Remote within the United States; must be authorized to work in the US full-time. Travel to the Seattle area is required for the final interview, with company summits twice per year.
Compensation: $140K–$225K annually, plus equity and bonus eligibility.
Company
is a profitable public benefit corporation founded in 2024 that develops physics-informed ML and enterprise AI solutions for climate, sustainability, energy, real estate, logistics, and utilities.
What you will do
- Own the LLM gateway, including model routing, usage metering, budgets, guardrails, and hosted or self-hosted provider adapters.
- Develop retrieval and knowledge services with connectors, chunking, hybrid search, reranking, grounded answers, and an MCP interface.
- Build evaluation infrastructure with confidence intervals and per-segment regression analysis.
- Own the asynchronous framework, public API, rate-limiting algorithms, administration tools, and its evolution toward durable agent execution.
- Design authorization across the platform, including token hierarchies, capability grammars, and tested tenant isolation.
- Ship observability, evaluations, traces, cost accounting, and operational dashboards for every feature.
Requirements
- 5+ years of deep production experience with asynchronous Python, including cancellation scopes, streaming lifecycles, and connection pooling.
- Strong production experience with Postgres infrastructure, MVCC, advisory locks, vacuum discipline, Redis or Dragonfly, and distributed systems.
- Experience designing API surfaces used by other engineers, including versioning, idempotency, error vocabularies, migrations, and documentation.
- Depth in either LLM gateway engineering or retrieval engineering, with working credibility in the other area.
- Practical experience with Python, FastAPI or Starlette, Pydantic, asyncpg or SQLAlchemy, Postgres with pgvector, and Redis or Dragonfly with Lua.
- Current authorization to work full-time in the United States is required; cannot sponsor or take over employment visa sponsorship.
Nice to have
- Experience in energy, real estate, utilities, climate, or related industries.
- Experience in both startup and enterprise environments.
- Exposure to OpenTelemetry GenAI conventions, SSE, OpenAI or Anthropic APIs, job frameworks, rate-limit algorithms, and integer-cents money handling.
Culture & Benefits
- Fully remote work culture with a cluster of teammates in Seattle.
- Health insurance with meaningful dependent coverage.
- Flexible paid time off.
- Equity and bonus eligibility.
- Work on AI transformation for critical industries and climate-related challenges.
Hiring process
- Final interviews take place in the Seattle area, requiring travel.
- Company summits require travel twice per year.
- Applicants may apply to a maximum of two roles within a six-month period.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
Senior Backend Engineer (AI)
210 000 - 265 000$
5 дней назад
Software Engineer (AI Infrastructure)
226 000 - 283 000$
4 дня назад
Senior Backend / Infrastructure Engineer (Python/AWS)
230 000 - 300 000$
4 дня назад
Senior Backend Engineer (Cybersecurity)
202 190 - 273 551$
4 дня назад
Backend or Fullstack Developer (AI)
140 000 - 200 000$
3 дня назад
Senior Engineer (Cybersecurity)
199 750 - 235 000$