Назад
Company hidden
4 дня назад

Staff AI Platform Engineer (Inference & Agentic Systems)

Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Canada
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Staff AI Platform Engineer (Inference & Agentic Systems) (LLMs/Distributed Systems/Fintech): Building multi-model inference infrastructure and an agentic AI platform for production fintech workflows with an accent on model serving, orchestration, tool use, and safety. Focus on designing reliable multi-agent systems, optimizing latency and throughput, and evaluating and debugging autonomous workflows in production.

Location: Toronto, Canada; hybrid workplace

Company

hirify.global Labs is a small team of AI builders developing inference and agentic systems for payments, risk, fraud, collections, support, and developer experience.

What you will do

  • Build and operate multi-model serving infrastructure for text, voice, code, and vision models.
  • Own the model lifecycle, including deployment, monitoring, updating, swapping, and production reliability.
  • Optimize inference latency, throughput, and cost through quantization, batching, caching, and routing.
  • Architect agent runtimes, orchestration systems, SDKs, APIs, and developer tooling for autonomous agents.
  • Build multi-agent coordination, safe tool-use infrastructure, workflow automation, permissioning, sandboxing, and human-in-the-loop controls.
  • Define technical direction, evaluation and observability standards, and mentor engineers across complex AI initiatives.

Requirements

  • 8+ years of software engineering experience, including 3+ years in AI systems or LLM applications.
  • Strong knowledge of LLM agent architectures, tool use, multi-step workflows, multi-agent coordination, and failure modes.
  • Experience building reliable distributed systems and evaluating LLM systems in production, including regression detection and debugging non-deterministic failures.
  • Proficiency in TypeScript or Python, with willingness to work with TypeScript on Bun, Temporal, Kubernetes, and EC2, as well as Python for inference.
  • Experience with modern LLM APIs or open-source models, cloud platforms such as AWS or GCP, and containerized deployments.
  • Understanding of agentic security risks, including prompt injection, privilege escalation, and data leakage, plus experience leading complex technical initiatives.

Nice to have

  • Experience building agentic systems in regulated industries such as fintech, healthcare, or enterprise.
  • Familiarity with Model Context Protocol, agent communication standards, Temporal, Airflow, or Prefect.
  • Experience with fine-tuning, quantization, LoRA, CI/CD automation, developer tooling, voice or multimodal models, edge inference, or oversight systems.

Culture & Benefits

  • Inclusive workplace focused on diversity and equal opportunity.
  • Accessibility accommodations are available during the recruitment and selection process in accordance with applicable Ontario requirements.
  • AI tools may support parts of the hiring process, while final hiring decisions remain with human reviewers.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →