Staff Applied AI Engineer (LLM Systems, Memory & Evaluation)

Location: Remote in the US or Canada; hybrid available in New York or Toronto

Salary: $250,000–$300,000 + equity

Company

A rapidly scaling, venture-backed enterprise AI company building conversational AI technology for personalized learning, development and workplace support.

What you will do

• Build and improve production LLM systems using context retrieval, long-term memory, personalization and agentic workflows.
• Design evaluation frameworks and feedback loops for conversation quality, groundedness, safety and user experience.
• Experiment with frontier models and emerging techniques, turning measurable improvements into production capabilities.
• Develop prompting, context-engineering and orchestration strategies that improve reasoning, reliability and efficiency.
• Optimize AI systems for latency, cost, observability, scalability and production performance.
• Collaborate with Product, Engineering and Design, while providing architecture and technical leadership across teams at Staff level.

Requirements

• 6+ years of software engineering or machine learning engineering experience, including at least 2 years building and shipping LLM-powered capabilities into production.
• Strong Python skills and experience developing reliable backend or ML systems.
• Practical knowledge of modern LLM architectures, retrieval, prompting, tool use and agentic workflows.
• Experience evaluating or improving the quality and reliability of real-world AI applications.
• Demonstrable ownership of production LLM systems used by real customers.
• Ability to identify technical opportunities independently, experiment rapidly, deliver measurable improvements and make tradeoffs across quality, performance, reliability and cost.
• Strong communication skills and ability to work across engineering and product stakeholders.
• Staff-level candidates must show influence on technical direction and engineering standards beyond individual projects.

Nice to have

• Experience with Azure AI, fine-tuning or real-time voice systems.

Culture & Benefits

• Permanent role with remote work in the US or Canada, with hybrid options in New York or Toronto.
• Hands-on ownership of context, memory, personalization and evaluation capabilities affecting conversational AI experiences.
• Opportunity to shape technical decisions and determine which emerging AI technologies reach production.
• Work within a scaling AI company with established enterprise demand and a product focused on professional development.