AI Product Manager

TL;DR

AI Product Manager (Evaluation): Designing and establishing evaluation frameworks for AI products like Dola App with an accent on human-machine evaluation integration and actionable insights from data analysis. Focus on staying at the forefront of LLM evaluation methodologies and cross-functional collaboration to enhance model capabilities and user experience.

Location: Singapore

Company

hirify.global is a global technology company founded in 2012, known for its mission to inspire creativity and enrich life through products like TikTok, Douyin, and Dola.

What you will do

• Design and establish evaluation frameworks for AI products, including standards, test cases, and workflows.
• Integrate human expert and automated evaluation processes, ensuring alignment and increasing testing coverage.
• Analyze evaluation findings to generate actionable insights and inform product design strategies for model enhancement.
• Facilitate cross-functional collaboration between product, engineering, and evaluation teams globally.
• Research industry-leading LLM evaluation methodologies to continuously improve the evaluation framework.

Requirements

• Bachelor's degree or above in Computer Science, Data Science, Business Analytics, or related fields.
• 3+ years of experience as a Product Manager, Business Analyst, or Operations Specialist in technology.
• Strong data analysis skills, including designing metrics for product performance.
• Project management capabilities and adaptability to new tools, technologies and concepts.
• Genuine passion for AI/LLM technologies.
• Professional proficiency in both English and Mandarin is required for collaboration across APAC.

Nice to have

• Experience in AI/ML product management, particularly with conversational AI.
• Hands-on experience with LLM evaluation methodologies.
• Background in developing metrics frameworks for measuring product performance.
• Excellent stakeholder management and communication skills.

Culture & Benefits

• Join an AI-native innovation business team focused on LLM products (Doubao/Dola).
• Opportunity to explore innovative opportunities in AI and grow in a dynamic team environment.
• Work towards inspiring creativity and enriching life through innovative products.
• Collaborate with global, diverse teams with a curiosity-driven, humble, and impact-oriented mindset.
• Committed to creating an inclusive space where employees are valued.
• Operate with an "Always Day 1" mindset for meaningful breakthroughs.