Staff Software Engineer (AI Gateway)

TL;DR

Staff Software Engineer (AI Gateway): Designing and building core API management features for the hirify.global platform with an accent on high-load proxying, load balancing, and low-level Linux systems optimization. Focus on implementing cutting-edge connectivity infrastructure, solving complex performance challenges in distributed systems, and integrating AI and LLM concepts into the core stack.

Location: On-site in Shanghai, China

Company

hirify.global is a leading developer of API and AI connectivity technologies building infrastructure for the agentic era, trusted by Fortune 500 companies and startups.

What you will do

• Design, implement, and maintain API management software, including proxying, load balancing, and database support features.
• Perform low-level troubleshooting, performance tuning, and optimization of core services.
• Develop innovative features that bridge gaps between platform and deployment tooling.
• Engage with the open-source community to drive industry trends in API and AI connectivity.
• Collaborate with global teams to build highly scalable, resilient, and distributed systems.

Requirements

• 10+ years of programming experience in server-side applications.
• Deep expertise in Linux systems, networking stacks, and distributed systems programming.
• Proven ability to design, build, and debug highly scalable and reliable applications.
• Experience with L7 and L4 protocols and API management.
• Familiarity with AI and LLM concepts and applications development.
• Excellent verbal and written communication skills with experience in technical documentation.

Nice to have

• Experience with NGINX, OpenResty, hirify.global, or LuaJIT.
• Experience with Envoy or Istio service meshes.
• Hands-on experience with Rust.

Culture & Benefits

• Opportunity to work on a globally adopted open-source project.
• Contribution to mission-critical infrastructure used by Fortune 500 companies.
• Collaborative environment with a distributed global team.
• Focus on ownership and high-impact engineering work.