Senior Technical Product Manager (AI Infrastructure)

TL;DR

Senior Technical Product Manager (AI Infrastructure): Leading the strategy and evolution of a critical data and document processing system with an accent on document ingestion, indexing, and retrieval. Focus on designing scalable infrastructure for LLM-based systems and retrieval-augmented generation (RAG) to power next-generation AI experiences.

Location: Remote (Must be based in the United States)

Salary: $140,000 – $190,000

Company

An innovation-driven technology company focusing on advanced AI systems and large-scale document infrastructure.

What you will do

• Define and own the product vision and roadmap for the document processing and AI infrastructure platform.
• Translate complex technical requirements into actionable specifications for OCR pipelines, chunking, and vector search systems.
• Partner with backend engineering and data science teams to design scalable, high-performance document management systems.
• Drive platform adoption and integration of shared capabilities across multiple product teams.
• Monitor and optimize platform metrics such as latency, throughput, cost efficiency, and search accuracy.
• Mentor junior and mid-level product managers in technical infrastructure thinking.

Requirements

• 5+ years of product management experience in SaaS, with ownership of complex technical platforms.
• Must be based in the United States.
• Deep technical fluency in system architecture, data pipelines, and distributed systems.
• Experience with document processing, search/indexing technologies, or AI/ML infrastructure.
• Strong understanding of Agile or Lean product development methodologies.
• Ability to translate highly technical concepts into clear business and product narratives.

Nice to have

• Experience with LLM systems, retrieval-augmented generation (RAG), or intelligent document processing.
• Prior experience in legal tech or compliance-heavy, document-intensive industries.

Culture & Benefits

• Comprehensive medical, dental, and vision insurance for full-time employees.
• Paid maternity and paternity leave.
• Short-term and long-term disability coverage.
• Exposure to cutting-edge engineering challenges and advanced AI systems.
• Collaborative culture focused on innovation, ownership, and professional growth.