Software Engineer Evaluation Frontend (AI)

TL;DR

Software Engineer Evaluation Frontend (AI): Build tools for visualization and analysis of large language model evaluations with an accent on statistical and data visualization techniques. Focus on designing interactive dashboards and statistical tools to extract insights from noisy experimental data.

Location: Remote, with offices in London, New York, Toronto, Montreal, Paris, and San Francisco

Company

hirify.global is a leading AI company focused on training and deploying frontier models for developers and enterprises to build advanced AI systems.

What you will do

• Design tools and visualizations to compare and analyze hundreds of model evaluations.
• Develop statistical tools to extract meaningful signals from noisy data.
• Collaborate closely with researchers and engineers to surface insights for model development.
• Understand the merits and limitations of model evaluations and suggest new evaluation facets.

Requirements

• Location: No restrictions, fully remote-friendly
• Strong software engineering skills.
• Experience with statistical analysis of scientific experiments and model performance.
• Prior experience building frontend visualization systems and dashboards.
• Familiarity with ML system evaluations and proficiency in Python and ML frameworks (PyTorch, TensorFlow, JAX).
• Excellent communication skills for cross-functional collaboration.
• Publications in top-tier ML/AI conferences or journals are a plus.

Culture & Benefits

• Inclusive and open culture with a focus on diversity.
• Work with a cutting-edge AI research team.
• Weekly lunch stipend, in-office lunches, and snacks.
• Full health and dental benefits including mental health budget.
• 100% parental leave top-up for up to 6 months.
• Personal enrichment benefits and remote-flexible work policy.
• 6 weeks of vacation (30 working days).