Qualitative Evaluation Engineer (AI)

Location: Redwood City, California, United States; hybrid

Salary: $150,000–$250,000 per year plus equity

Company

hirify.global builds unified general intelligence systems that generate, understand, and operate in the physical world, with a focus on multimodal intelligence and vision.

What you will do

• Evaluate generative model performance across tasks, prompts, and modalities, identifying failure modes, regressions, and edge cases.
• Build scalable, reusable qualitative evaluation frameworks for model capabilities.
• Translate product goals and abstract qualities into concrete, testable evaluation criteria.
• Lead qualitative studies, side-by-side comparisons, and human-in-the-loop evaluations.
• Convert nuanced judgments into actionable feedback for fine-tuning, dataset curation, and product UX.
• Collaborate with researchers, engineers, and technical artists to align evaluations with model capabilities and creative use cases.

Requirements

• 5+ years of experience in product evaluation, UX research, model testing, or a similar structured qualitative assessment discipline.
• Master's degree or higher in Cognitive Science, HCI, Design Research, Psychology, Media Studies, or a related field.
• Deep familiarity with creative workflows for generative models, including animation, filmmaking, digital art, or VFX.
• Ability to define abstract qualities such as believability and scene coherence in clear evaluative terms.
• Excellent written communication and ability to synthesize nuanced judgments into actionable insights.
• Ability to work across engineering, research, and creative disciplines.

Nice to have

• Background in motion, visual effects, or storytelling pipelines.
• Experience evaluating AI-generated video, images, or 3D content.
• Experience building internal tools for qualitative data collection or scoring.
• Familiarity with prompt engineering and reference-based inputs.

Culture & Benefits

• Hybrid work based in Redwood City, California.
• Equity is included in the compensation package.
• Equal opportunity employer.