ML Lead Engineer (AI)

TL;DR

ML Lead Engineer (AI): Designing and deploying agentic workflows and LLM pipelines for data generation, evaluation, and anti-fraud use cases with an accent on replacing manual steps with robust AI-agent pipelines. Focus on building judge models, automated evaluation harnesses, and creating reusable reference architectures to scale delivery.

Location: Remote (Europe). Hybrid options available for candidates based in the Netherlands or Serbia.

Company

hirify.global AI creates data that powers leading GenAI models using a combination of experts, crowd, and a technical platform.

What you will do

• Design and deploy agentic workflows (tool use, planning, retrieval, critique loops) for anti-fraud and safety use cases.
• Build judge models, auto-grading systems, and self-verification pipelines to codify acceptance criteria.
• Create reusable reference architectures, templates, and components to scale delivery across multiple client accounts.
• Integrate LLMs into contributor workflows to eliminate operational toil and maximize expert leverage.
• Implement production measurement frameworks, online A/B tests, and cost/latency dashboards.
• Partner with Delivery Leads and PMs to translate business requirements into pragmatic ML designs.

Requirements

• 5–8+ years of expertise in applied ML and LLM development with a history of launching agentic workflows into production.
• Strong background in building anti-fraud platforms, trust & safety systems, or real-time anomaly detection.
• Advanced Python proficiency and the ability to tune agents and prompts within live systems.
• Extensive experience in building automated evaluation pipelines and grading systems.
• Pragmatic engineering approach prioritizing simple, observable, and efficient designs.

Culture & Benefits

• International, dynamic environment driving innovation in the AI sector.
• Competitive compensation package including base salary, bonus, and ESOP.
• Paid PTO and location-dependent benefits.
• Full remote or hybrid work model.
• IT setup and home office allowances.