Director of Product Management (AI Agents)

TL;DR

Director of Product Management (Weave): Define and scale the platform that AI developers rely on to build, evaluate, and operate AI agents in production with an accent on agent tracing, evaluation workflows, and production monitoring. Focus on designing systems for high-scale data ingestion, real-time analysis, developer-facing APIs/SDKs, and observability for LLMs and agent architectures.

Location: San Francisco, CA requires in-office presence at least 3 days per week to support collaboration. Remote work may be considered for candidates located more than 30 miles from an office, based on role requirements. Must be a U.S. person (citizen, permanent resident, refugee, or asylee) due to export controlled information.

Salary: $206,000 - $303,000

Company

CoreWeave acquired hirify.global to build the most powerful end-to-end platform for developing, deploying, and iterating AI, combining cloud infrastructure with tools for experiment tracking, model optimization, and agent building.

What you will do

• Own the Weave product vision and roadmap for enabling developers to build, evaluate, and monitor AI agents end-to-end.
• Define tracing and debugging for agent behavior, including multi-step workflows, tool use, and reasoning chains.
• Lead development of evaluation systems to measure agent quality, correctness, and performance.
• Drive production monitoring and observability, including logging, metrics, feedback loops, and drift detection.
• Build workflows for rapid iteration from experimentation to production.
• Partner with engineering on high-scale data systems and APIs/SDKs; lead cross-functional initiatives and engage with customers.

Requirements

• 7+ years of product management experience with focus on developer platforms, AI/ML tools, or data/observability systems.
• Experience building products for AI developers around LLMs, agents, or ML workflows.
• Deep understanding of LLM-powered applications, agent architectures, tool use, RAG, and orchestration.
• Experience with evaluation systems, benchmarking, human-in-the-loop feedback, or automated scoring.
• Experience with observability, logging, monitoring tools; understanding of AI production challenges like latency, cost, reliability, and drift.
• Technical fluency for working on APIs, SDKs, system design; familiarity with AI tooling ecosystems.

Nice to have

• Experience building products for AI agent development, evaluation, or observability.
• Background in ML experimentation, model evaluation, or data-centric AI workflows.
• Familiarity with W&B, Weave, or similar MLOps/LLMOps tools.
• Experience with developer-first products like APIs, SDKs, CLI tools.
• Exposure to data infrastructure, analytics platforms, or event-driven systems.

Culture & Benefits

• Core values: Be Curious at Your Core, Act Like an Owner, Empower Employees, Deliver Best-in-Class Client Experiences, Achieve More Together.
• Comprehensive benefits: 100% paid medical/dental/vision, life/disability insurance, FSA/HSA, tuition reimbursement, ESPP, mental wellness, family-forming support, paid parental leave, childcare support, 401(k) with match, flexible PTO.
• Hybrid work environment prioritized; catered lunch in offices, casual culture focused on innovation and collaboration; quarterly team gatherings and onboarding at hubs.