Senior Software Engineer (AI Platform)

TL;DR

Senior Software Engineer (AI Platform): Building and operating foundational infrastructure for intelligent experiences with an accent on model training pipelines, GPU orchestration, and high-throughput inference services. Focus on designing scalable backend systems, managing Kubernetes-based workloads, and ensuring reliability for privacy-respecting AI systems at global scale.

Location: Must be based in Canada

Salary: $95,000 – $139,000 CAD

Company

A non-profit-backed technology company dedicated to building an open, accessible, and privacy-focused internet.

What you will do

• Design, build, and operate core platform services and APIs for production AI workloads.
• Manage Kubernetes-based infrastructure, including GitOps pipelines and resource optimization.
• Optimize backend services for throughput, latency, and cost efficiency.
• Implement observability practices including metrics, logging, and alerting for operational resilience.
• Collaborate with product, infrastructure, and security teams to enable scalable platform capabilities.
• Participate in on-call rotations and drive incident response and post-incident reviews.

Requirements

• Must be based in Canada
• 4–6 years of relevant industry experience in building and operating production systems.
• Strong modern Python skills with experience in building libraries and CLIs.
• Proven experience deploying and operating production-grade infrastructure on GCP and GKE.
• Hands-on experience with Kubernetes, Helm, and Terraform.
• Experience designing and running scalable APIs and managing database deployments (Postgres).
• Effective communication skills and experience collaborating across cross-functional teams.

Nice to have

• Experience with Ray or Ray Serve for GPU-backed model serving.
• Experience building stateless ML services or multi-provider LLM gateways.
• Familiarity with privacy-preserving ML techniques and responsible AI design.
• Contributions to open-source infrastructure projects.

Culture & Benefits

• Generous performance-based bonus plans.
• Comprehensive medical, dental, and vision coverage.
• Generous retirement contributions with 100% immediate vesting.
• Quarterly all-company wellness days and well-being stipends.
• Annual professional development budget and home office stipend.
• Considerable paid parental leave.