TL;DR
Data Scientist Intern (AI): Building and evaluating LLM-based applications for customer care with an accent on performance, reliability, and safety. Focus on developing rigorous evaluation frameworks, red teaming, and translating insights into actionable product improvements.
Location: Paris, France (Hybrid work environment with 2 remote days a week and 1 remote work week per quarter, plus 3 flex days)
Salary: €1,400–€1,600 per month
Company
hirify.global is a global marketplace for refurbished devices, aiming to make tech reliable, affordable, and better than new, reducing environmental impact.
What you will do
- Develop and implement comprehensive LLM evaluation frameworks to assess performance and reliability across internal tools and chatbot applications.
- Evaluate the accuracy and consistency of LLMs for extracting insights from customer conversations (sentiment, tone, behaviors).
- Design thorough testing methodologies for chatbot applications, including exploring edge cases and conducting red teaming exercises.
- Collaborate closely with engineering and product teams to translate evaluation insights into actionable improvements.
- Guide model selection decisions and system enhancements based on evaluation findings.
- Support broader ML initiatives by contributing to statistical analysis and other machine learning efforts.
Requirements
- Mandatory: Currently enrolled in your last year of an Engineering School with specialization in Data Science/Engineering or University Master's degree and your university can provide an internship agreement.
- Strong foundation in AI/ML concepts; experience working with Large Language Models is appreciated.
- Proficiency in Python and experience with ML libraries.
- Analytical mindset with experience in data analysis and statistical evaluation methods.
- Our working language is English; fluency is required (no French required).
Nice to have
- Experience with LLM frameworks (OpenAI API, etc.).
- Knowledge of AI evaluation metrics and benchmarking methodologies.
- Familiarity with conversational AI and chatbot technologies.
Culture & Benefits
- Mission-driven work environment where your day-to-day work impacts the planet.
- Hybrid work environment, with 2 remote days a week, 1 remote work week per quarter, and 3 flex days.
- Employee Resource Groups, including mentorship programs, comprehensive accessibility policies, and cultural competency training.
- Impact-driven work with hands-on career development in an innovative, driven, and fast-paced environment.
Hiring process
- Video-call Interview with the Campus Tech Recruitment Manager (30min).
- Video-call Technical fit interview: Live coding + open talk with the tutor (60min).
- Video-call Team fit interview with 2 engineers/members from the team (30min).
Будьте осторожны: если вас просят войти в iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →