AI Gateway Engineer (AI)

Location: Milan, Italy; on-site

Salary: €77,180–€95,340 per year, plus equity and bonus eligibility

Company

hirify.global is building an AI connectivity layer and unified API and AI platform for securing, managing, accelerating, governing, and monetizing API and AI traffic across models and clouds.

What you will do

• Design and own core components of the AI Gateway, targeting 99.99% uptime and low-latency performance for critical AI traffic.
• Implement prompt engineering, caching, and observability features for AI services using maintainable Golang and/or Python code.
• Architect integrations with large language models and AI platforms and influence the technical roadmap and system architecture.
• Drive the full development lifecycle from ideation and design through deployment and operation in Kubernetes.
• Mentor junior engineers through code reviews and design discussions while fostering technical ownership and rapid iteration.
• Collaborate with product managers and cross-functional teams to translate customer requirements into technical solutions.

Requirements

• Extensive backend development experience, preferably with Golang and/or Python.
• Deep understanding of distributed systems, microservices architecture, and API design principles.
• Proven experience designing and operating services in a cloud-native environment using Kubernetes, Docker, and AWS, GCP, or Azure.
• Familiarity with API gateways, service mesh, or related infrastructure technologies.
• Strong computer science fundamentals, including data structures, algorithms, and concurrency.
• Ownership mindset, initiative, and responsibility for features from conception through production.
• Ability to work effectively in a fast-paced environment while balancing quality and rapid delivery.
• Strong collaboration and communication skills in a globally distributed team.

Nice to have

• Experience with AI/ML infrastructure, LLMs, or frameworks such as LangChain or LlamaIndex.
• Contributions to open-source projects.
• Experience tuning and optimizing high-throughput systems.
• Knowledge of Lua/OpenResty.

Culture & Benefits

• Work with a globally distributed team and cross-functional partners.
• Benefits may include health, dental, and vision insurance.
• Paid holidays and paid time off.
• Professional development opportunities and tools.
• Equity and bonus eligibility.