Staff Machine Learning Engineer (Generative AI)

Location: Toronto, Ontario, Canada; hybrid work

Salary: $168,000–$231,000 CAD annual base salary

Company

Okta builds identity, authentication, and security infrastructure, including AI-enabled services and developer experiences for generative AI and AI agents.

What you will do

• Architect, design, and deploy scalable machine learning and generative AI systems with retrieval, inference, and evaluation pipelines.
• Build structured prompting, context retrieval, and RAG workflows for Claude-based systems.
• Develop automated evaluation pipelines for model quality, correctness, groundedness, and safety.
• Implement schema validation, structured output enforcement, and guardrails for reliable, auditable, and compliant AI outputs.
• Design scalable infrastructure, platform services, and LLMOps pipelines for production AI applications.
• Mentor engineers and collaborate with Product, Security, Platform Engineering, researchers, and product managers.

Requirements

• 7+ years of software development experience and strong Python programming skills.
• Hands-on experience with applied machine learning, model training and fine-tuning, and modern generative AI platforms such as AWS Bedrock, OpenAI, or Anthropic.
• Deep understanding of RAG, embeddings, knowledge-base workflows, and AI agent frameworks such as LiteLLM, LangGraph, LangChain, LlamaIndex, or MCP.
• Experience with ML frameworks and tools including FastAPI, PyTorch, TensorFlow, Spark ML, and workflow orchestration tools such as Airflow.
• Experience defining evaluation metrics, pipelines, feedback loops, and infrastructure for production ML and generative AI systems.
• Ability to lead greenfield initiatives, navigate ambiguity, collaborate cross-functionally, and iterate quickly.

Nice to have

• Experience integrating AI systems with identity, authentication, or security products.
• Exposure to ethical AI, model risk, or compliance frameworks.
• Familiarity with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
• Familiarity with Go or TypeScript.

Culture & Benefits

• Health, dental, and vision insurance.
• RRSP matching, healthcare spending, and telemedicine.
• Paid leave, including PTO and parental leave.
• Equity and bonus opportunities where applicable.
• In-person onboarding and connection across a global community.