Evaluation Lead (AI)

Location: Remote in Europe or Israel

Company

hirify.global is an AI research lab developing NEXUS, a large tabular model for enterprise decision-making and structured business data.

What you will do

• Build and lead the shared evaluation platform used by engineering, research, and Applied AI.
• Maintain curated datasets, model benchmarks, reproducible pipelines, versioned inputs, and evaluation artifacts.
• Define standards for metrics, data splits, leakage prevention, calibration, uncertainty, and benchmark contamination.
• Benchmark NEXUS against competing approaches using fair tuning budgets, resource constraints, and latency measurement protocols.
• Measure predictive quality, latency, and cost across deployment configurations, task types, and dataset characteristics.
• Hire and develop the team while remaining hands-on with code, experiment design, customer evaluations, and research recommendations.

Requirements

• Experience owning evaluation for production tabular ML systems or systems used in consequential customer decisions.
• Strong statistical judgment across metrics, validation schemes, uncertainty estimation, model comparison, and repeated experimentation.
• Practical experience identifying leakage in preprocessing, feature construction, joins, temporal dependencies, and related entities across data splits.
• Strong Python and SQL skills, with familiarity with scikit-learn, gradient-boosted trees, and reliable ML tooling or platforms.
• Experience designing fair model comparisons, including hyperparameter search, resource budgets, and end-to-end latency measurement.
• Prior people management experience, including hiring, technical coaching, and performance feedback, while remaining technically involved.

Nice to have

• Experience evaluating tabular foundation models or AutoML systems.
• Experience measuring the effects of model optimizations on predictive quality and inference performance.
• Experience with relational or multi-table data and Snowflake or Databricks environments.
• Experience evaluating automated or agent-driven ML workflows and failures hidden by aggregate metrics.

Culture & Benefits

• Competitive compensation including salary and equity.
• Comprehensive health coverage for employees and dependents.
• Paid parental leave for all new parents, including adoptive and surrogate journeys.
• Relocation support for employees moving to one of the office locations.
• Mission-driven, low-ego culture focused on diversity of thought, ownership, and bias toward action.