4 дня назад
Staff AI Platform Engineer (Inference & Agentic Systems)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Staff AI Platform Engineer (Inference & Agentic Systems) (LLMs/Distributed Systems/Fintech): Building multi-model inference infrastructure and an agentic AI platform for production fintech workflows with an accent on model serving, orchestration, tool use, and safety. Focus on designing reliable multi-agent systems, optimizing latency and throughput, and evaluating and debugging autonomous workflows in production.
Location: Toronto, Canada; hybrid workplace
Company
Labs is a small team of AI builders developing inference and agentic systems for payments, risk, fraud, collections, support, and developer experience.
What you will do
- Build and operate multi-model serving infrastructure for text, voice, code, and vision models.
- Own the model lifecycle, including deployment, monitoring, updating, swapping, and production reliability.
- Optimize inference latency, throughput, and cost through quantization, batching, caching, and routing.
- Architect agent runtimes, orchestration systems, SDKs, APIs, and developer tooling for autonomous agents.
- Build multi-agent coordination, safe tool-use infrastructure, workflow automation, permissioning, sandboxing, and human-in-the-loop controls.
- Define technical direction, evaluation and observability standards, and mentor engineers across complex AI initiatives.
Requirements
- 8+ years of software engineering experience, including 3+ years in AI systems or LLM applications.
- Strong knowledge of LLM agent architectures, tool use, multi-step workflows, multi-agent coordination, and failure modes.
- Experience building reliable distributed systems and evaluating LLM systems in production, including regression detection and debugging non-deterministic failures.
- Proficiency in TypeScript or Python, with willingness to work with TypeScript on Bun, Temporal, Kubernetes, and EC2, as well as Python for inference.
- Experience with modern LLM APIs or open-source models, cloud platforms such as AWS or GCP, and containerized deployments.
- Understanding of agentic security risks, including prompt injection, privilege escalation, and data leakage, plus experience leading complex technical initiatives.
Nice to have
- Experience building agentic systems in regulated industries such as fintech, healthcare, or enterprise.
- Familiarity with Model Context Protocol, agent communication standards, Temporal, Airflow, or Prefect.
- Experience with fine-tuning, quantization, LoRA, CI/CD automation, developer tooling, voice or multimodal models, edge inference, or oversight systems.
Culture & Benefits
- Inclusive workplace focused on diversity and equal opportunity.
- Accessibility accommodations are available during the recruitment and selection process in accordance with applicable Ontario requirements.
- AI tools may support parts of the hiring process, while final hiring decisions remain with human reviewers.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
10 дней назад
Staff Engineer (AI)
170 000 - 190 000CAD
4 дня назад
Senior Backend Engineer (AI)
5 дней назад
Staff Agentic AI Engineer (Marketing)
10 дней назад
Senior Software Engineer (AI)
153 845 - 170 039CAD
11 дней назад
Senior Software Engineer (AI)
148 000 - 197 000$
9 дней назад
Software Developer, AI Engineering & SDLC Transformation (AI)
101 000 - 118 000CAD