Senior Systems Engineer (AI Gateway)

Location: In-office in Austin, TX or San Francisco, CA

Salary: $194,000–$266,000 annual salary for Bay Area-based hires; compensation may vary by work location.

Company

hirify.global operates a global network that protects and accelerates Internet applications and provides infrastructure and developer platform products.

What you will do

• Build core AI Gateway systems handling high-volume inference traffic across providers, models, and hirify.global’s global network.
• Design APIs, routing primitives, observability capabilities, controls, and developer workflows.
• Improve reliability, performance, cost efficiency, and debuggability for latency-sensitive AI workloads.
• Collaborate across Workers AI, Agents, and the broader Developer Platform organization.
• Turn ambiguous product and technical ideas into prototypes, design documents, shipped features, and measurable production improvements.
• Develop SDKs, dashboards, documentation, tests, agents, evaluation loops, and operational tools while mentoring engineers through technical leadership.

Requirements

• 5+ years of experience building and operating production systems, ideally in AI infrastructure, developer platforms, cloud infrastructure, edge systems, high-scale APIs, or distributed systems.
• Strong fundamentals in networking, APIs, reliability, observability, data modeling, performance, and operational tradeoffs.
• Experience designing or scaling distributed systems where latency, throughput, availability, and correctness matter.
• Ability to work across API design, product surfaces, backend services, queues, storage systems, control planes, and performance-critical code.
• Strong technical communication and experience writing design documents, reviewing architecture, and aligning engineering and product partners.
• Comfort using AI-native development workflows, agents, tools, harnesses, and automation.

Nice to have

• Experience with AI/ML infrastructure, inference platforms, model gateways, LLM applications, or provider abstraction layers.
• Experience building developer-facing APIs, SDKs, CLIs, dashboards, or platform products at scale.
• Experience with proxy, edge, gateway, routing, traffic management, cost controls, rate limits, caching, retries, fallbacks, or AI workload observability.
• Experience with TypeScript, Go, Rust, or similar systems and backend languages.
• Experience building agentic development environments or products with AI Gateway, Workers AI, or a competing platform.

Culture & Benefits

• Hands-on individual contributor role focused on building and operating production infrastructure.
• Medical, dental, and vision insurance, flexible spending accounts, and family-forming benefits.
• 401(k), employee stock participation, disability insurance, and life and accident insurance.
• Flexible paid time off covering vacation and sick leave, plus parental, pregnancy health, medical, and bereavement leave.
• Global travel medical insurance and on-demand mental health support.

Hiring process

• Candidates who progress to the offer stage may be asked to attend an in-person interview at a hirify.global office or hub.
• The role may require access to information protected under U.S. export control laws; employment may depend on authorization to receive controlled technology without export-license sponsorship.