Senior Software Engineer (AI Platform)

TL;DR

Senior Software Engineer (AI Platform): Building and maintaining scalable AI platform infrastructure and integrating generative AI tools into healthcare workflows with an accent on Kubernetes, container security, and real-time performance monitoring. Focus on designing robust AI infrastructure components, implementing CI/CD pipelines for model deployment, and ensuring high-availability for LLM inference workloads.

Location: Must reside within commutable distance to Mississauga, Ontario

Salary: $142,000–$158,000 CAD

Company

A leading health tech company providing a platform for long-term and post-acute care providers, recognized for its innovative culture and commitment to AI-driven healthcare solutions.

What you will do

• Design and maintain AI platform infrastructure, including Kubernetes and container security.
• Develop and optimize tools and applications using Java and Spring Boot.
• Implement and manage CI/CD pipelines for AI model deployment and platform operations.
• Ensure real-time performance through advanced observability and monitoring frameworks.
• Collaborate with cross-functional teams to integrate AI tools into daily workflows.
• Apply Generative AI Code Assistants and spec-driven development in daily tasks.

Requirements

• Must reside within commutable distance to Mississauga, Ontario
• Extensive experience building and maintaining AI platform infrastructure.
• Proficiency in Java and experience with cloud-native streaming (Azure Event Hub/Service Bus).
• Deep knowledge of Kubernetes, container security, and relational databases.
• Demonstrated expertise in observability frameworks like OpenTelemetry.
• Experience with AI infrastructure components such as vector databases and prompt stores.

Nice to have

• Experience with Kafka or Kafka-compatible platforms.
• Knowledge of vLLM, SGLang, or similar frameworks for LLM inference.
• Familiarity with authentication frameworks like OAuth and OpenID Connect.
• Experience working on SaaS products and service-oriented architecture.

Culture & Benefits

• Comprehensive benefits package starting from Day 1.
• Retirement plan matching and wellness support programs.
• Flexible paid time off and parental/caregiver leaves.
• Continuous development support and learning opportunities.
• Inclusive culture with dedicated allyship and inclusion communities.