Principal Software Development Engineer (AI)

TL;DR

Principal Software Development Engineer (AI): Building and scaling the AI Model Serving platform and production model registry with an accent on performance, reliability, and scalability. Focus on optimizing Ray Serve clusters, integrating LLM vendors, and designing high-throughput infrastructure for AI agents.

Location: Toronto, ON, Canada. Must spend at least 50% of time each quarter in the office

Salary: $168,000 - $252,000 CAD

Company

Fortune 500 company and a leading AI platform for managing people, money, and agents.

What you will do

• Define the product vision for the AI Model Serving platform in partnership with engineering management.
• Lead critical design decisions to drive performance, reliability, and scalability across the platform.
• Design, implement, and maintain large-scale systems for deploying ML models to production.
• Write detailed design documents to build consensus for new system components and enhancements.
• Troubleshoot, improve, and scale continuous integration software pipelines.
• Mentor other engineers and foster an inclusive, high-performance team culture.

Requirements

• 8+ years of experience in software development with a focus on large-scale distributed systems.
• Deep proficiency in Python and experience building production-level systems.
• Hands-on experience with Ray and Ray Serve for distributed model serving at scale.
• Experience with Prometheus for monitoring and observability of distributed systems.
• Familiarity with both Large Language Models (LLMs) and traditional ML model serving and scaling.
• Location: Based in Toronto, ON, Canada with a requirement to be in-office at least 50% of the time per quarter

Culture & Benefits

• Flex Work model combining remote work with intentional in-person collaboration.
• Eligible for the hirify.global Bonus Plan and annual refresh stock grants.
• Comprehensive corporate benefits package.
• Culture rooted in integrity, empathy, and shared enthusiasm.
• Environment that encourages taking risks and provides tools for long-term growth.