Senior Product Manager, Agent QA & Localization Quality (AI)

TL;DR

Senior Product Manager, Agent QA & Localization Quality (AI): Building an AI-native localization stack and automated quality systems for agentic translation workflows with an accent on evaluation infrastructure and AI-driven testing tools. Focus on designing LLM evaluation harnesses, building RLHF feedback loops, and automating the detection of localization defects in live products.

Location: Onsite in Singapore

Company

OKX is a leading crypto exchange and developer of the OKX Wallet, providing millions of users and institutions access to crypto trading and decentralized applications.

What you will do

• Build an AI-driven product testing tool to automatically detect localization defects such as truncation, layout breakage, and incorrect formatting across mobile and web apps.
• Manage the quality gate of the agentic translation pipeline, optimizing the balance between automation coverage and risk.
• Develop evaluation and annotation infrastructure, including golden datasets, error classification tooling, and RLHF feedback loops for agent fine-tuning.
• Establish metric frameworks and dashboards to transform subjective quality problems into measurable, automatable systems.
• Lead cross-functional collaboration between AI teams, engineering, linguists, and designers in a multicultural environment.

Requirements

• 5+ years of experience in product or program management, with deep hands-on expertise in localization (TMS like Phrase/Smartling, i18n, terminology management).
• Proven track record of shipping AI/ML or evaluation-driven products or internal tooling.
• Fluency in LLM evaluation, including designing eval harnesses, prompt engineering, and analyzing failure modes like hallucination and prompt drift.
• Strong data fluency with the ability to reason about precision/recall trade-offs and define complex quality metrics.
• Must be based in or able to work onsite in Singapore.

Nice to have

• Bilingual or multilingual proficiency, particularly in Chinese or European languages.
• Experience with CMS platforms (e.g., Contentful, Webflow) and design tools like Figma.
• Prior experience in crypto, fintech, or other highly regulated domains.

Culture & Benefits

• Competitive total compensation package.
• L&D programs and education subsidies for professional growth.
• Comprehensive healthcare schemes for employees and their dependents.
• Wellness and meal allowances.
• Regular team building programs and company events.