Staff Product Manager, AI Inference

Location: Bellevue, Washington or Sunnyvale, California

Base salary: $207,000–$275,000 per year, plus discretionary bonus, equity awards, and benefits.

Company

CoreWeave provides cloud infrastructure, tools, and services for organizations building and scaling artificial intelligence applications.

What you will do

• Define the product strategy, vision, roadmap, and portfolio for AI inference cloud services.
• Develop scalable inference capabilities for foundation models and solve novel scaling challenges on specialized hardware.
• Optimize AI workloads across inference engines, GPUs, cloud infrastructure, and cloud-native architectures.
• Engage customers to understand AI workloads, pain points, and future requirements.
• Lead collaboration across engineering, design, sales, marketing, customer success, and industry partners.
• Develop go-to-market strategies covering pricing, positioning, messaging, and competitive differentiation.

Requirements

• 8+ years of product management experience, including at least 5 years in cloud services or AI/ML.
• Deep hands-on knowledge of foundation model inference, vLLM, SGLang, TensorRT-LLM, llm-d, quantization, and speculative decoding.
• Experience with GPU cloud infrastructure, Kubernetes, microservices, and cloud-native architectures.
• Proven ability to lead cross-functional teams, make decisions, manage projects, mentor others, and influence stakeholders.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related technical field.
• Applicants must be eligible to access U.S. export-controlled information under applicable U.S. government regulations.

Nice to have

• MBA or equivalent experience.
• Experience driving business growth through innovative AI and cloud products.

Culture & Benefits

• Fast-moving, entrepreneurial environment focused on innovation and independent thinking.
• Medical, dental, and vision insurance fully paid by CoreWeave for eligible U.S. employees.
• Life, disability, mental wellness, family-forming, childcare, and parental leave benefits.
• 401(k) with employer match, ESPP participation, tuition reimbursement, and flexible PTO.
• Catered lunches at office and data center locations.