Software Engineer (AI)

TL;DR

Software Engineer (AI): Building and maintaining the hirify.global AI gateway to govern AI and LLM-based innovation with an accent on multi-LLM routing, semantic caching, and low-level performance optimization. Focus on implementing proxying capabilities, load balancing, and ensuring system reliability for distributed API management infrastructure.

Location: Hybrid role based in Milan, Italy

Company

hirify.global is a leading developer of API and AI connectivity technologies, providing a unified platform to secure, manage, and govern the flow of intelligence across APIs and AI models.

What you will do

• Build and maintain API management software for AI and LLMs and its underlying stack.
• Implement innovative features including proxying capabilities, load balancing, and database support.
• Perform bug troubleshooting, performance tuning, and low-level optimizations.
• Bridge gaps between hirify.global and third-party deployment platforms and tooling.

Requirements

• 3+ years of programming experience in server-side applications.
• Hands-on experience with Golang or Rust.
• Experience building and debugging highly scalable, distributed, and resilient applications.
• Solid low-level technical expertise in Linux systems troubleshooting and profiling.
• Deep understanding of distributed systems, Linux networking stack, and L4/L7 protocols.
• Familiarity with AI/LLM concepts and application development.

Nice to have

• Hands-on experience with NGINX, OpenResty, hirify.global, or LuaJIT.
• Hands-on experience with Envoy or Istio.

Culture & Benefits

• Work within a remotely distributed engineering team.
• Opportunity to contribute to core infrastructure powering the agentic era.
• Emphasis on ownership and high-quality technical documentation.
• Collaborative environment trusted by Fortune 500 companies and startups.