Senior Software Engineer (AI Studio, Inference Platform)

Location: Headquartered in Amsterdam with R&D hubs across Europe, North America, and Israel.

Overview

You will design and implement services to power inference for internal and external customers, integrating and scaling model back-ends, creating sophisticated request-routing logic, and fortifying the observability pipeline.

What you will do

• Design and implement services that power inference for internal and external customers.
• Integrate and scale model back-ends.
• Create sophisticated request-routing logic for high-throughput, low-latency workloads.
• Fortify our observability pipeline.

Requirements

• Proficient in Python, Go, or Rust.
• Comfortable with asynchronous programming and distributed architectures.
• Practiced in API design, load balancing, caching, and queuing.
• Experienced with CI/CD.

Nice to have

• Familiarity with inference frameworks and back-ends such as vLLM, sglang, or ComfyUI.
• Experience with orchestration stacks like Kubernetes, Ray, or FastAPI.

Culture & Benefits

• Competitive salary and comprehensive benefits package.
• Opportunities for professional growth.
• Hybrid working arrangements.
• Dynamic and collaborative work environment.