Senior Software Engineer (MLOps)

TL;DR

Senior Software Engineer (MLOps): Designing and building an internal AI platform for training, evaluating, and deploying models at scale with an accent on dataset labeling, model benchmarking, trust & safety evaluation, and performance diagnostics. Focus on scaling evaluation systems, developing benchmarking tools, and driving trust & safety observability across AI product offerings.

Location: Hybrid (Paris, France; Sophia Antipolis, France)

Company

hirify.global is building an internal AI platform that empowers teams to train, evaluate, and deploy models at scale.

What you will do

• Design and build systems supporting automated evaluation of AI models, including LLMs and agents.
• Lead efforts to develop benchmark suites, evaluation pipelines, and model comparison tooling with trust & safety metrics.
• Build and maintain integrations with labeling systems and coordinate annotation workflows.
• Collaborate with Applied AI and Bits AI teams to enable fast iteration and interpretable evaluations.
• Develop data pipelines that feed metrics, results, and alerts into the observability stack.
• Drive best practices around safe model deployment by building systems for bias checks, hallucination detection, and human-in-the-loop review.

Requirements

• 6+ years of software engineering experience, including 2+ years working with ML/AI products or platforms.
• Experience building backend or data infrastructure systems for model evaluation, benchmarking, or labeling workflows.
• Comfortable working across the stack: from orchestrating large-scale data processing pipelines to building UI integrations.
• Solid understanding of ML concepts, including model performance metrics, prompt evaluation, and trust & safety concerns.
• Fluent in Python or Go and familiar with cloud-native development patterns.

Nice to have

• Experience with open-source evaluation frameworks (e.g., lm-eval-harness).
• Experience with vector databases.
• Experience with human feedback loops.

Culture & Benefits

• New hire stock equity (RSUs) and employee stock purchase plan (ESPP).
• Continuous professional development, product training, and career pathing.
• Intradepartmental mentor and buddy program for in-house networking.
• Inclusive company culture and access to Community Guilds (hirify.global employee resource groups).
• Free, global mental health benefits for employees and dependents age 6+.
• Competitive global benefits (may vary based on country of employment).