Principal Software Engineer (AI)

TL;DR

Principal Software Engineer (AI): Driving AI-first and data-first transformation across healthcare products and platforms with an accent on production-grade agentic and data-driven solutions. Focus on designing scalable RAG architectures, building robust AI data pipelines, and mentoring engineering teams to elevate AI maturity.

Location: Remote (Canada). Travel to Mississauga and/or Salt Lake City offices is required for onboarding and team events.

Company

A leading health tech company providing a SaaS platform for over 30,000 provider organizations in the long-term and post-acute care sector.

What you will do

• Lead the reference architecture for AI and agentic systems, defining standards for reasoning loops, orchestration, and memory management.
• Design and deliver production-ready AI systems focusing on reliability, scalability, observability, and cost efficiency.
• Establish platform-level AI components including model brokers, multi-model routing, and evaluation frameworks.
• Lead the design of end-to-end AI data pipelines including OCR, NER, embeddings, and vector stores.
• Partner with Product Management to identify and validate AI-driven opportunities to improve clinical and business outcomes.
• Mentor and coach senior and intermediate engineers to raise overall capability in AI and data architecture.

Requirements

• Proven experience leading and delivering production AI systems across multiple engineering teams.
• Strong background in AI engineering with a data-first mindset and experience with large-scale data pipelines.
• Hands-on experience with modern AI/agent frameworks such as LangChain, LangGraph, AutoGen, CrewAI, or LlamaIndex.
• Deep understanding of RAG and agentic architectures, embeddings, and vector databases.
• Experience implementing security-by-design and responsible AI practices in regulated enterprise SaaS environments.
• Must be based in Canada.

Nice to have

• Experience deploying AI systems in healthcare or HIPAA-aligned environments.
• Familiarity with model serving infrastructure and multi-model routing for performance optimization.
• Master's degree in Artificial Intelligence, Computer Science, or a related field.

Culture & Benefits

• Comprehensive benefits starting from Day 1.
• Retirement plan matching and flexible paid time off.
• Wellness support programs, parental, and caregiver leaves.
• Fertility and adoption support.
• Continuous development support program.
• Inclusive environment with allyship and inclusion communities.