2 дня назад
Fullstack Software Engineer III/Senior, AI Gateway (AI)
202 500 - 247 500$
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Fullstack Software Engineer III/Senior, AI Gateway (AI): Building AI-aware gateway components, traffic policies, usage tracking, and observability for production AI traffic with an accent on real-time request-path processing, safety, and explainable enforcement. Focus on designing rate limits and access rules, measuring token consumption, and aligning policy, billing, and customer usage signals across Go and TypeScript systems.
Location: Remote for candidates outside the Bay Area; hybrid for candidates within commuting distance to San Francisco, with office attendance on Tuesdays and Wednesdays. All candidates must be based in the United States.
Salary: $165,600–$247,500 annually, depending on level, compensation tier, and location.
Company
provides a cloud networking platform for securing, transforming, and routing traffic to services, including production AI workloads.
What you will do
- Build and evolve AI-aware gateway components that classify and handle AI traffic in real time.
- Design and implement traffic policy objects for rate limits, usage caps, and access control.
- Track AI requests, tokens, and related metadata to provide accurate usage information.
- Expose observable and explainable signals showing policy decisions, blocked or allowed traffic, and accumulated usage.
- Work with product and design to create safe, intentional AI gateway abstractions.
- Collaborate with Gateway, Customer Data, and Platform teams to align usage data, policy enforcement, and billing signals.
Requirements
- Experience with a statically typed, compiled language such as Go, Rust, C++, or Java; Go is preferred.
- Frontend engineering experience with TypeScript, React, HTML, and CSS.
- Experience working with AI or LLM systems and their edge cases.
- Ability to define system behavior and design abstractions that simplify complex workflows.
- Understanding of retries, limits, costs, and production reliability.
- US work authorization on a permanent, ongoing basis without current or future visa sponsorship.
Nice to have
- Experience with AI platforms or inference infrastructure.
- Experience with product-oriented API gateways.
- Background in usage limits, quotas, or billing-adjacent systems.
- Experience building customer-facing observability tools.
Culture & Benefits
- Health, dental, and vision premiums are fully covered for employees, with partial dependent coverage.
- 401(k) matching, flexible vacation, parental leave, and mental health support.
- Annual professional development and home office stipends.
- Co-working space support for employees away from the San Francisco office.
- Company offsites twice a year and regular performance feedback.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
2 дня назад
Staff Software Engineer (AI)
205 000 - 230 000$
2 дня назад
Senior Software Engineer (AI)
180 000 - 200 000$
1 день назад
Software Engineer - Java Fullstack (AI)
68 911 - 161 544$
2 дня назад
Senior Fullstack Engineer (AI)
220 000 - 300 000$
2 дня назад
Software Engineers (AI)
175 000 - 225 000$
2 дня назад
Software Engineers (AI)
135 000 - 170 000$