Senior Software Engineer, Backend (AI)

TL;DR

Senior Software Engineer, Backend (AI) (Go/Python): Building and optimizing a unified LLM API gateway to provide secure and reliable access to multiple large language models with an accent on high-throughput routing, proxying, and cost accountability. Focus on designing multi-provider routing systems, implementing distributed rate limiting, and ensuring the scalability of critical AI infrastructure.

Location: Onsite in Petaling Jaya, Malaysia

Company

hirify.global is Southeast Asia's leading superapp, providing a diverse range of services including food delivery, financial management, and transportation.

What you will do

• Build and manage the AI Gateway (hirify.globalGPT Gateway) to unify access to 60+ LLM providers.
• Design multi-provider routing systems with support for SSE streaming and automatic fallback.
• Develop low-latency reverse-proxy services using Go and Python.
• Implement reliability and governance layers, including distributed rate limiting via Redis and OIDC authentication.
• Manage CI/CD pipelines, Kubernetes deployments, and cloud resources across AWS, GCP, and Azure.
• Ensure system reliability for a Tier-critical service through on-call rotations and root cause analysis.

Requirements

• 3+ years of professional software development experience.
• Proficiency in Go (Golang) and Python.
• Hands-on experience with LLMs, LangChain, and LangGraph.
• Practical experience with AWS, Kubernetes, and CI/CD pipelines.
• Strong knowledge of distributed systems, multi-threading, and data structures.
• Experience with relational databases such as PostgreSQL, MySQL, or Oracle.

Culture & Benefits

• Comprehensive Medical and Term Life Insurance.
• Flexible benefits package via hirify.globalFlex.
• Parental and Birthday leave.
• Volunteering leave through the Love-all-Serve-all (LASA) program.
• Confidential support via the hirify.globalber Assistance Programme.