Principal AI Platform Engineer (AI)

TL;DR

Principal AI Platform Engineer (AI): Building the core infrastructure layer supporting GenAI products, including model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools with an accent on secure access controls, observability, and scalability. Focus on optimizing for high availability, cost efficiency, and seamless integration with agent workflows and downstream applications.

Location: Remote (Mississauga, CA)

Salary: CAD $169,000 - $188,000 a year

Company

Leading provider of software solutions for senior care, building centralized GenAI capabilities integrated across engineering teams.

What you will do

• Design, build, and maintain core infrastructure for GenAI products including model gateways, prompt stores, vector databases, and LLM evaluation tools.
• Implement secure access controls and authentication mechanisms into AI platform components.
• Develop observability, monitoring, and logging solutions for GenAI workloads.
• Collaborate with product and engineering teams to integrate GenAI infrastructure with agent frameworks and applications.
• Optimize infrastructure for scalability, high availability, and cost efficiency in production.

Requirements

• Extensive experience building and maintaining AI platform infrastructure, Kubernetes, and container security.
• Demonstrated expertise in observability and monitoring frameworks with real-time performance focus (e.g., OpenTelemetry, MLFlow).
• Experience with AI infrastructure components such as vector databases, prompt/versioning stores, and AI IDEs.

Nice to have

• Familiarity with vLLM, SGLang or similar for hosting LLM inference workloads.
• Experience with CI/CD pipelines and automation for AI model deployment.
• Strong knowledge of authentication and authorization frameworks for AI platforms.

Culture & Benefits

• Full-time remote position with bonus and comprehensive benefits package.
• Total rewards include base salary aligned to experience, skills, and market context.