Data Scientist (AI)

TL;DR

Data Scientist (AI): Analyzing agent outputs and improving GenAI systems with an accent on context engineering, evaluation criteria, and translating findings into technical improvements. Focus on debugging agent behavior, designing evaluation frameworks, and collaborating with product managers and engineers.

Location: Onsite in Amsterdam, North Holland

Company

Levy is an international IT staffing organization providing recruitment and project resourcing services to companies ranging from start-ups to well established global players.

What you will do

• Analyze agent outputs to identify failures, context gaps, and improvement opportunities.
• Define and apply evaluation criteria and metrics for agent performance.
• Improve context engineering through better retrieval, data structuring, and source onboarding.
• Collaborate with product managers and engineers to translate findings into technical improvements.
• Design lightweight tests and validations to measure the impact of changes.

Requirements

• Strong understanding of agentic GenAI systems and LLM-based applications.
• Experience reasoning about prompts, context windows, retrieval, and grounding.
• Solid technical integration skills, including APIs, data pipelines, and data flow debugging.
• Analytical mindset with the ability to design evaluation frameworks beyond classical ML metrics.
• Clear communicator able to explain insights and proposals to technical and non-technical stakeholders.