Staff AI Engineer (SaaS)

TL;DR

Staff AI Engineer (SaaS): Designing and building production-grade AI systems, including RAG pipelines and agentic workflows, with an accent on the intersection of technical capability and product judgment. Focus on implementing model evaluation frameworks, optimizing MLOps, and delivering full-stack AI-native features.

Location: Hybrid: Must be based in New York, NY (in-office 3 days per week)

Salary: $250,000 - $280,000

Company

A product intelligence platform helping software teams understand and serve their users through AI-native experiences.

What you will do

• Design and build AI-native systems, including RAG pipelines, agentic workflows, and LLM-powered product features.
• Determine model strategies by making principled decisions on when to use prompting versus fine-tuning.
• Establish rigorous evaluation frameworks to instrument model outputs and mitigate hallucinations.
• Own MLOps, including model deployment, monitoring, latency optimization, and reliability at scale.
• Partner with product and design teams to frame problems and define the roadmap for AI-native experiences.
• Lead technical direction by integrating advances in transformers, diffusion architectures, and emerging agent patterns.

Requirements

• Deep hands-on experience shipping LLM-powered systems, including retrieval-augmented generation and agent orchestration.
• Proven ability to set technical direction, establish architectural patterns, and influence AI strategy across teams.
• Strong command of model evaluation, bias-variance tradeoffs, and systematic hallucination detection.
• Solid understanding of modern model architectures, specifically transformers and diffusion models.
• Production MLOps experience involving monitoring pipelines and cost/reliability optimization in live environments.
• Strong full-stack fundamentals to deliver complete, user-facing AI products.

Nice to have

• Experience fine-tuning foundation models.
• Familiarity with AI safety considerations and guardrail frameworks.
• Experience with LangChain, LlamaIndex, or custom orchestration frameworks.
• Background in SaaS or product analytics environments.
• Prior experience launching a net-new team or product area.

Culture & Benefits

• Hybrid work model requiring 3 days in-office per week.
• Highly competitive health coverage with $0 premium options.
• Strong 401(k) match and equity grants.
• Flexible time off.
• High-autonomy environment focused on rapid prototyping and shipping without clear precedents.