Data & AI / ML Evaluation Engineer

Location: EMEA - U.K.

Company

hirify.global develops browser security products that protect organizations from threats across the web, documents, email, and AI-agent workflows.

What you will do

• Design and operate automated data collection, mining, and web-scraping pipelines for threat samples from surrogate traffic and web sources.
• Build data processing, annotation, dataset curation, model training, and retraining workflows for Prompt Injection SLMs, Shadow-AI detection, Malicious Macro classifiers, and PII detection.
• Capture false-positive samples from live user and DDR flows and integrate them into retraining pipelines.
• Develop automated benchmarking and evaluation harnesses for detection quality, runtime performance, and accuracy against baseline models such as Vertex AI.
• Collaborate with research and software engineering teams to convert detection telemetry into model improvements.

Requirements

• 2–4 years of experience in software engineering, data engineering, or automated QA/evaluation roles.
• Strong Python programming proficiency; C++, SQL, and related programming experience are advantageous.
• Experience with model training and various ML and AI algorithms.
• Experience building data pipelines, web scrapers, or automated data-processing systems.
• Familiarity with data structures, storage formats, and database configurations.
• A methodical approach to dataset labeling, validation, bug logging, and metric tracking.

Nice to have

• Hands-on experience with ML evaluation frameworks, dataset curation, or annotation tools.
• Familiarity with text extraction, NLP preprocessing, or document parsing.
• Understanding of cybersecurity concepts including Prompt Injection, Malicious Macros, and DLP/PII.
• Basic experience with cloud storage, object stores, and Docker.
• Experience with AWS, GCP, Terraform, Kubernetes, and Linux.

Culture & Benefits

• Full-time role within the R&D department.
• Culture centered on Proactive Leadership, Straight Talk, United Impact, Elevated Talent, and Customer-Compelled decision-making.
• Employment consideration is provided without discrimination based on protected characteristics.

Hiring process

• Agencies may submit resumes only through Ashby with a valid services agreement and Talent-team assignment to the specific requisition.