Principal Product Manager (AI)

TL;DR

Principal Product Manager (AI): Defining, driving, and scaling the W&B Inference Service, a critical component of the platform, with an accent on performance, reliability, and usability for customers. Focus on shaping complex distributed systems, coordinating highly technical teams, and delivering platform capabilities that unlock velocity for AI practitioners.

Location: Hybrid work environment in Livingston, NJ, New York, NY, San Francisco, CA, Sunnyvale, CA, or Bellevue, WA. Remote work may be considered for candidates located more than 30 miles from an office, provided they meet role requirements for specialized skill sets. New hires will be invited to attend onboarding at one of our hubs within their first month. Teams also gather quarterly to support collaboration. Applicants must be a U.S. person (U.S. citizen, lawful permanent resident, refugee, or asylee) due to export control regulations.

Salary: $206,000–$303,000 USD (base salary range).

Company

hirify.global, acquired by CoreWeave (the AI Hyperscaler™), provides an end-to-end platform for developing, deploying, and iterating AI faster.

What you will do

• Own the execution and evolution of the W&B Inference Service, delivering solutions that directly support the product vision and long-term platform strategy.
• Lead cross-team initiatives end-to-end, coordinating engineering, product, security, operations, and go-to-market stakeholders.
• Prioritize with intention, making informed trade-offs among performance, reliability, compliance, cost, and development velocity.
• Elevate developer and practitioner experiences by improving the operability, observability, and usability of the inference service.
• Own execution from requirements through launch, defining success metrics and gathering customer and system insights.

Requirements

• Seasoned product manager with 7+ years working on high-scale platform or infrastructure products.
• Direct experience in model serving, inference systems, real-time APIs, or distributed compute services.
• Experience across domains intersecting with inference, including autoscaling, observability, GPU/accelerator utilization, routing/orchestration, developer tooling, IAM, and storage.
• Deep technical fluency to engage engineers on service architectures, performance bottlenecks, deployment topologies, and reliability trade-offs for low-latency inference.
• Adept at coordinating teams across inference runtime, infrastructure, security, operations, and go-to-market.
• Customer empathy for ML practitioners running production models and internal developers building on the inference platform.
• Applicants must be a U.S. person (U.S. citizen, lawful permanent resident, refugee, or asylee).

Nice to have

• Direct experience as a PM for an inference or model-serving service, ideally involving real-time, low-latency, or high-throughput workloads.
• Familiarity with frameworks like TensorFlow, PyTorch, or model-serialization formats.
• Background in adjacent platform domains such as identity & access management, billing and metering workflows, or data infrastructure.
• Strong familiarity with cloud infrastructure (AWS, GCP, Azure), container orchestration, autoscaling, and deployment automation tools.
• Exposure to W&B or similar MLOps tools, especially experiment tracking, model management, or deployment workflows.

Culture & Benefits

• Opportunity to shape the future of AI in an exciting stage of hyper-growth.
• Medical, dental, and vision insurance (100% company-paid).
• Company-paid Life Insurance and voluntary supplemental life insurance.
• Flexible Spending Account (FSA) and Health Savings Account (HSA).
• 401(k) with a generous employer match and Flexible PTO.
• Tuition Reimbursement and ability to Participate in Employee Stock Purchase Program (ESPP).
• Flexible, full-service childcare support with Kinside.