Senior Product Manager, AI Experimentation Platform

Location: Cottonwood Heights, Utah, United States; hybrid with in-office work 3 days per week. A mandatory in-person interview is required before an offer.

Company

hirify.global operates a portfolio of ecommerce sites focused on outdoor and specialty retail.

What you will do

• Own the vision, roadmap, prioritization, and end-to-end delivery of an agentic experimentation platform across multiple ecommerce sites.
• Define how AI agents support hypothesis generation, variant creation, test setup and QA, monitoring, and ship-or-rollback decisions.
• Establish statistical guardrails, anomaly and sample-ratio checks, revenue and margin thresholds, approval workflows, and automatic rollback.
• Build adaptive optimization using multi-armed and contextual bandits, and partner on assignment, bucketing, feature flags, event tracking, metrics, and the GA4/BigQuery stats engine.
• Define platform success metrics, enable self-serve experimentation, and create standards and playbooks for test design, metric definitions, and readouts.
• Work with engineering, design, analytics, merchandising, marketing, and data science to turn business goals into a shipped platform and testing culture.

Requirements

• 5+ years of product management experience, including ownership of a platform, data, or internal tooling product.
• Hands-on experience running or building A/B testing and experimentation programs at scale in ecommerce or other high-traffic digital products.
• Strong statistical grounding in experiment design, including power and sample size calculation, significance, peeking, multiple comparisons, and guardrail metrics.
• Hands-on experience building with AI and LLMs, including agentic workflows, prompt design, tool integrations, and evaluating AI output quality.
• Working knowledge of feature flagging, randomization, event tracking, and warehouse-native metrics.
• Strong analytical skills with hands-on use of SQL, GA4, BigQuery, Looker, or similar tools.
• Demonstrated measurable impact on conversion, revenue, or testing speed.
• Excellent communication skills and the ability to influence engineering, data, and business stakeholders.

Nice to have

• Experience with Optimizely, Statsig, Eppo, GrowthBook, LaunchDarkly, or an equivalent in-house experimentation platform.
• Experience with multi-armed or contextual bandits, Bayesian methods, or variance reduction techniques such as CUPED.
• Experience testing AI- or ML-driven search, recommendation, or personalization experiences.
• Experience running experimentation across multiple brands or storefronts on a shared platform.
• Background in outdoor, specialty, or multi-brand ecommerce.

Culture & Benefits

• Lean, builder-oriented environment with end-to-end ownership and fast decision-making.
• Work on AI agents performing production experimentation and autonomous optimization.
• Paid time off, 401(k) match, medical, dental, vision, and supplemental policies.
• Employee discounts across the portfolio of brands.

Hiring process

• Recruiter screen lasting approximately 30 minutes.
• Take-home AI or product-building challenge, followed by hiring manager and technical/case discussions covering experimentation, statistics, and platform architecture.
• In-person interview at the Cottonwood Heights office, reference checks, and offer; the process may change.