TL;DR

Python Developer (ML): Lead design and development of low-latency algorithm inference services handling billions of requests daily with an accent on real-time decisioning engines, model deployment, and system scalability. Focus on building scalable, highly available systems with comprehensive observability and optimizing latency, throughput, and cost-efficiency.

What you will do

Lead design and development of low-latency algorithm inference services handling billions of requests per day
Build and scale robust real-time decisioning engines integrating ML models with business logic under strict SLAs
Collaborate closely with Data Science to ensure reliable and seamless model deployment into production
Design systems for model versioning, shadowing, and A/B testing at runtime
Guarantee system scalability, high availability, and comprehensive observability
Continuously optimize latency, throughput, and cost-efficiency using modern tooling and techniques

Requirements

5+ years experience in high-performance backend/ML inference systems
Expertise in Python, low-latency APIs, and real-time serving frameworks (FastAPI, Triton Inference Server, TorchServe, BentoML)
Experience with scalable service architecture, message queues (Kafka, Pub/Sub), and async processing
Deep understanding of model deployment practices, online/offline feature parity, and real-time monitoring
Experience in cloud environments (AWS, GCP, or OCI) and container orchestration (Kubernetes)
Experience with in-memory and NoSQL databases (Aerospike, Redis, Bigtable) and observability tools (Prometheus, Grafana, OpenTelemetry)

Culture & Benefits

Remote work options