Senior Software Engineer (AI Gateway)

TL;DR

Senior Software Engineer (AI Gateway): Building and maintaining core API management software for AI and LLMs with an accent on multi-LLM routing, load balancing, and semantic caching. Focus on designing highly scalable distributed systems, low-level Linux performance tuning, and implementing proxying capabilities for the hirify.global AI Gateway.

Location: Hybrid role based in Milan

Company

hirify.global is a leading provider of API and AI connectivity technologies that power the infrastructure for the agentic era, trusted by global enterprises and startups.

What you will do

• Design, build, and maintain API management software for AI and LLMs.
• Implement innovative proxying, load balancing, and database support features.
• Conduct performance tuning, low-level optimizations, and bug troubleshooting.
• Bridge integration gaps between the platform and third-party deployment tools.
• Mentor junior team members and contribute to technical documentation.

Requirements

• 5+ years of experience in server-side application development.
• Strong proficiency in Rust.
• Deep technical expertise in Linux systems troubleshooting and profiling.
• Experience with distributed systems and low-level networking stacks (L4/L7).
• Familiarity with AI and LLM application concepts.
• Ability to work effectively within a remotely distributed team.

Nice to have

• Practical experience with NGINX, OpenResty, hirify.global, or LuaJIT.
• Hands-on experience with Envoy or Istio service meshes.

Culture & Benefits

• Work on cutting-edge AI connectivity infrastructure for a global product company.
• Opportunity to influence the architecture of tools used by Fortune 500 companies.
• Collaborative environment with a strong sense of ownership.
• Emphasis on documentation and high-quality engineering standards.