Principal Machine Learning Engineer (SecureAI)

Location: San Francisco, California; hybrid work with an in-person onboarding experience

Annual base salary: $238,000–$326,000 USD for candidates located in the San Francisco Bay Area.

Company

Okta builds identity and access management infrastructure, including security solutions for AI agents and the agentic era.

What you will do

• Implement intent-based enforcement to verify that agent runtime requests match their intended purpose.
• Apply LLM reasoning, prompt parsing, embeddings, vector search, and zero-shot classification to evaluate agent actions in real time.
• Integrate low-latency inference and semantic evaluation engines into API gateway request paths.
• Design confidence-scored decision engines that connect semantic verification with policy frameworks such as Cedar.
• Build scalable ML and Generative AI systems, including retrieval, inference, evaluation, RAG, and automated quality pipelines.
• Mentor engineers and help develop the Agent Access Policies sub-team.

Requirements

• 10+ years of software development experience and strong Python programming skills.
• Hands-on experience with applied machine learning, including feature engineering, model training, and fine-tuning.
• Experience with Generative AI platforms such as AWS Bedrock, OpenAI, or Anthropic.
• Deep understanding of RAG, embeddings, knowledge-base workflows, evaluation metrics, and feedback loops.
• Experience with AI agent frameworks or related tools, including LiteLLM, LangGraph, LangChain, LlamaIndex, or MCP.
• Bachelor’s or Master’s degree in Computer Science or a related field.

Nice to have

• Experience integrating AI systems with identity, authentication, or security products.
• Exposure to ethical AI, model risk, or compliance frameworks.
• Experience with evaluation datasets, synthetic data generation, or LLM-as-a-judge methods.
• Familiarity with Go or TypeScript, PyTorch, TensorFlow, Spark ML, FastAPI, and Airflow.

Culture & Benefits

• Equity, bonus, health, dental, and vision insurance.
• 401(k), flexible spending account, paid time off, and parental leave.
• In-person onboarding designed to accelerate impact and build connections.
• Global community spanning more than 20 offices and initiatives supporting well-being, social impact, and talent development.