Staff Machine Learning Engineer, Generative AI (Auth0)

Location: Hybrid in Toronto, Ontario, Canada

Salary: CAD 168,000–231,000 annual base salary for candidates located in Canada

Company

Okta provides identity and access management infrastructure, including secure authentication products through Auth0.

What you will do

• Architect, design, and deploy scalable machine learning and Generative AI systems integrating retrieval, inference, and evaluation pipelines.
• Build structured prompting, context retrieval, and RAG workflows for Claude-based systems.
• Develop automated evaluation pipelines measuring model quality, correctness, groundedness, and safety.
• Implement schema validation, structured outputs, and guardrails for reliable, auditable, and compliant AI results.
• Design scalable infrastructure and LLMOps platform services for production GenAI use cases.
• Mentor engineers and collaborate with Product, Security, Platform Engineering, researchers, and product managers.

Requirements

• 7+ years of software development experience and strong Python programming skills.
• Applied machine learning experience, including feature engineering, model training, and fine-tuning.
• Experience with Generative AI platforms such as AWS Bedrock, OpenAI, or Anthropic.
• Deep understanding of RAG, embeddings, knowledge-base workflows, and AI agent frameworks such as LiteLLM, LangGraph, LangChain, LlamaIndex, or MCP.
• Experience with ML frameworks and tools including FastAPI, PyTorch, TensorFlow, Spark ML, and Airflow.
• Ability to work in a hybrid role based in Toronto, Ontario, Canada.

Nice to have

• Experience integrating AI systems with identity, authentication, or security products.
• Exposure to ethical AI, model risk, or compliance frameworks.
• Experience with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
• Familiarity with Go or TypeScript.

Culture & Benefits

• Equity, bonus, and benefits are offered where applicable.
• Health, dental, vision, telemedicine, and healthcare spending benefits.
• RRSP matching and paid leave, including PTO and parental leave.
• In-person onboarding is designed to support connection and accelerate impact.
• Access to well-being, social impact, talent development, and community programs.