Software Engineer III/Senior (AI)

TL;DR

Software Engineer III/Senior (AI Gateway): Building and evolving AI-aware gateway components to identify and control AI traffic with an accent on real-time classification, policy enforcement, and usage tracking. Focus on designing scalable abstractions for AI traffic policies and ensuring high-performance observability in the request path.

Location: Remote for candidates outside the Bay Area and hybrid for those within commuting distance to San Francisco. All candidates must be US-based and legally authorized to work in the United States.

Salary: $165,600 – $247,500

Company

hirify.global is a cloud networking platform that provides a universal gateway for API delivery, AI inference, and secure connectivity for millions of developers.

What you will do

• Build and evolve AI-aware gateway components that classify and handle AI traffic in real time.
• Design and implement traffic policy objects, including rate limits, usage caps, and access rules for AI workloads.
• Develop systems to accurately measure AI usage, tokens, and related metadata for customer visibility.
• Create observability tools to provide clear signals on why AI traffic was allowed or blocked.
• Design abstractions that hide infrastructure complexity and provider quirks from customer workflows.
• Collaborate with Gateway, Customer Data, and Platform teams to ensure billing and policy alignment.

Requirements

• Proficiency in a statically typed, compiled language such as Go, Rust, C++, or Java (Go preferred).
• Experience working with AI/LLMs and an understanding of their specific edge cases.
• Must be US-based and legally authorized to work in the US without sponsorship.
• Strong focus on developer experience and thoughtful system abstractions.
• Experience with retries, limits, and cost-optimization in distributed systems.

Nice to have

• Experience with AI platforms or inference infrastructure.
• Work with API gateways and product-level policy implementation.
• Experience with usage limits, quotas, or billing-adjacent systems.
• Development of customer-facing observability tools.

Culture & Benefits

• Full premiums covered for base healthcare, dental, and vision; half covered for dependents.
• 401(k) with company matching up to 5%.
• Open and flexible vacation policy.
• Up to 16 weeks of parental leave for birth parents and 8 weeks for new parents.
• Annual professional development budget and home office/desk stipend.
• Co-working space stipend for remote employees.