обновлено 5 дней назад
Senior Software Engineer, Backend (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Software Engineer, Backend (AI) (Go/Python, LLM Gateway): Building Grab's unified AI Gateway, which provides secure and cost-accountable access to 60+ language models with an accent on multi-provider routing, streaming, authentication, rate limiting, and usage tracking. Focus on designing low-latency distributed services, operating Kubernetes and cloud infrastructure, and ensuring reliability for a Tier-critical service.
Location: Onsite in Petaling Jaya, Malaysia
Company
is Southeast Asia's leading superapp, providing food delivery, grocery, ride-hailing, financial, and other services.
What you will do
- Build and manage backend features for GPT Gateway, including provider integrations, unified API endpoints, model onboarding, identity management, rate limiting, tiering, and cost tracking.
- Design multi-provider LLM routing that translates an OpenAI-compatible API into provider-native formats with SSE streaming, automatic fallback, and provider-specific capabilities.
- Develop scalable, low-latency reverse-proxy services in Go and Python for organization-wide LLM traffic.
- Build reliability and governance capabilities using Redis, OIDC/workload identity, PostgreSQL, and data-lake integrations for usage logging, cost computation, and chargeback.
- Manage CI/CD, cloud resources across AWS, GCP, and Azure, Kubernetes deployments, database migrations, and staging and production configuration.
- Participate in on-call rotations, resolve provider capacity and quota incidents, conduct root cause analysis, and lead post-mortems.
Requirements
- 3+ years of professional software development experience.
- Proficiency in server-side programming with Go and Python.
- Hands-on experience with LLMs, LangChain, and LangGraph for conversational AI development.
- Practical experience with AWS, Kubernetes, and CI/CD pipelines.
- Understanding of data structures, algorithms, distributed systems, and multithreading.
- Experience with automated testing, technical documentation, and relational databases such as MySQL, PostgreSQL, or Oracle.
Culture & Benefits
- Term life insurance and comprehensive medical insurance.
- Flexible benefits package through Flex.
- Parental, birthday, and volunteering leave.
- Confidential employee assistance programme.
- Inclusive and equitable workplace with equal-opportunity employment practices.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
4 дня назад
Senior AI Engineer (Agentic Systems)
29 минут назад
Process Digitalisation Senior Engineer (Assistant Manager)
4 дня назад
AI/ML Software Development Intern (Manufacturing Automation)
7 дней назад
Artificial Intelligence & Machine Learning Engineer (Manufacturing)
4 дня назад
AI & Automation Solutions Manager
4 дня назад