Research Engineer on Evaluations (AI)

Location: Redwood City, California, United States; hybrid

Salary: $190,000–$375,000 per year, plus equity

Company

hirify.global builds unified general intelligence that can generate, understand, and operate in the physical world, with a focus on multimodal intelligence and vision.

What you will do

• Design and build scalable pipelines for automated evaluation of generative models across image, video, text, and audio.
• Develop metrics and evaluation models for fidelity, coherence, temporal consistency, and alignment with human intent.
• Integrate evaluation signals into training loops, including reinforcement learning and reward modeling.
• Build infrastructure for large-scale regression testing, benchmarking, and monitoring of multimodal models.
• Translate human evaluation frameworks into automated or semi-automated systems.
• Maintain dashboards, reporting, and alerting for evaluation results.

Requirements

• 5+ years of experience building ML evaluation systems, model pipelines, or large-scale infrastructure.
• Master's or PhD in Computer Science, Machine Learning, or a related field, or equivalent industry experience.
• Hands-on experience with visual data, especially image and/or video.
• Proficiency in Python and an ML framework such as PyTorch, JAX, or TensorFlow.
• Strong background in generative models, including diffusion models, LLMs, or multimodal architectures.
• Strong software engineering experience with CI/CD, testing, data pipelines, distributed systems, and human-in-the-loop evaluation.

Nice to have

• Experience with reinforcement learning, reward modeling, perceptual metrics, multimodal benchmarks, or retrieval-based evaluation.
• Background in large-scale model training or evaluation infrastructure.
• Familiarity with creative media workflows such as film, VFX, animation, or digital art.
• Contributions to open-source evaluation libraries or benchmarks.

Culture & Benefits

• Hybrid work arrangement in Redwood City, California.
• Equity included in the compensation package.
• Equal opportunity employment.