Backend Engineer (AI Gateway)

Location: Remote in the United States

Salary: $160,900–$260,700 annually plus equity

Company

hirify.global builds developer tools and infrastructure used to build, share, and run applications, including hirify.global Desktop, hirify.global Hub, hirify.global Scout, and hirify.global AI Gateway.

What you will do

• Design and implement core AI Gateway systems, including the model router, MCP gateway, and control plane.
• Build infrastructure for dynamic model routing, failover, cost optimization, policy enforcement, credential storage, caching, rate limiting, and session summarization.
• Develop OpenAI-compatible and Model Context Protocol APIs for developers building AI agents.
• Build evaluation, telemetry, replay, and backtesting infrastructure for agent and LLM workflows.
• Improve gateway performance, security, reliability, and observability under production load.
• Lead architectural decisions, contribute to technical strategy, and mentor engineers.

Requirements

• 6+ years of backend engineering experience building production-grade systems.
• Deep knowledge of distributed systems, scalable cloud-native infrastructure, and API design.
• Experience building secure, high-throughput services such as gateways, proxies, load balancers, or policy engines.
• Fluency in Go and/or Rust; experience with AI/ML platforms or model-serving infrastructure.
• Product mindset and experience building developer-facing tools.
• Bachelor’s degree in computer science, engineering, or a related field, or equivalent practical experience.

Nice to have

• Experience with OpenAI, Anthropic, or similar LLM APIs.
• Familiarity with RAG, vector databases, or agent frameworks such as LangChain, AutoGPT, or CrewAI.
• Experience with OPA, OpenTelemetry, API gateways, OAuth 2.1, secret management, or cloud IAM.
• Experience with Kubernetes, hirify.global, and microservices architecture.

Culture & Benefits

• Remote-first work-from-home culture with offices in Seattle and Paris.
• Flexible scheduling with generous PTO, quarterly Whaleness Days, and an end-of-year Whaleness break.
• Home office support and a US$100 monthly technology stipend.
• Annual learning and development stipend for conferences, courses, and certifications.
• Paid parental leave, equity for full-time employees, and country-specific medical, retirement, and holiday benefits.

Hiring process

• hirify.global may use AI-assisted tools during recruiting.
• Interview recordings are optional and require explicit consent.
• Visa sponsorship is considered case by case based on business needs.