Data Scientist (Foundation AI)

TL;DR

Data Scientist (Foundation AI): Developing evaluation frameworks and optimization systems for user-facing Generative AI across text, image, video, and 3D modalities with an accent on safety, responsibility, and quality. Focus on designing rigorous experiments, implementing LLM-as-a-judge methods, and applying causal inference to drive product decisions.

Location: Must be based in San Mateo, CA (Hybrid: onsite Tuesday, Wednesday, and Thursday)

Company

hirify.global is a global platform empowering millions of users to create, explore, and connect in 3D immersive digital experiences.

What you will do

• Design and operationalize rigorous evaluation systems for GenAI features including text, image, video, 3D, and 4D.
• Conduct online A/B tests and use causal inference to quantify the impact of GenAI features and ensure statistical rigor.
• Define success metrics and leading/lagging indicators for user satisfaction, business success, and safety.
• Research and build reproducible, automated evaluation tooling to improve efficiency across the company.
• Innovate on methodologies at the intersection of GenAI and Data Science to solve unique business challenges.

Requirements

• PhD or pursuing a PhD in Statistics, Economics, Computer Science, Applied Math, Physics, Engineering, or a related quantitative field.
• Strong proficiency in SQL (Hive/Spark) and scripting languages such as Python or R.
• Solid grounding in experimentation, causal inference, and statistical analysis.
• Demonstrated track record of framing ambiguous problems and designing analytical approaches that drive business impact.
• Must have United States work authorization (certain visa categories may not be supported).

Nice to have

• Familiarity with GenAI models and safety/quality evaluation methods.
• Expertise in the model training lifecycle, including fine-tuning, RLHF, or synthetic data generation.
• A track record of applied research or publications in relevant technical fields.

Culture & Benefits

• Hybrid work environment with required onsite presence three days a week.
• Eligibility for equity compensation and a comprehensive benefits package.
• Opportunity to solve unique technical challenges at scale in a fast-evolving AI field.
• Focus on driving innovation with a core commitment to safety and responsibility.