Senior LLM Engineer (AI)

TL;DR

Senior LLM Engineer (Production AI Systems): Designing, building, and operating LLM-powered systems in production with an accent on architecture, evaluation, latency, and cost control. Focus on establishing evaluation frameworks, architecting RAG pipelines, and implementing guardrails for model reliability and safety.

Location: Hybrid in Bois-Colombes (France) or Bari (Italy), requiring 8 days/month onsite attendance.

Company

hirify.global's Digital eXperience Group (DXG) focuses on driving customer-focused innovation and growing revenue in digital products through advanced technologies and AI.

What you will do

• Design and implement LLM-based systems for production use cases.
• Participate in architectural decisions around model selection, prompt designs, and data flows.
• Optimize LLM usage for latency, cost, and reliability.
• Establish and own the evaluation framework for AI systems.
• Architect, build, and rigorously evaluate RAG pipelines.
• Implement guardrails and constraints to improve model reliability and safety.

Requirements

• Strong Python skills, with production-grade engineering standards.
• Proven experience building and operating LLM systems in production, including performance and latency trade-offs.
• Deep understanding of LLM failure modes (hallucinations, drift, prompt sensitivity) and a metric-driven approach to mitigating them.
• Ability to work autonomously and make sound engineering trade-offs under real-world constraints.
• Professional-level English communication skills (C1).
• Must be based in Bois-Colombes (France) or Bari (Italy).

Nice to have

• Hands-on experience deploying, serving, and optimizing open-source large language models (e.g., Llama 3, Mistral, Mixtral) in production.
• Familiarity with LLM application frameworks and orchestration layers (e.g., LangChain, LlamaIndex).
• Strong DevOps / MLOps background.

Culture & Benefits

• Be part of a team of more than 7,000 professionals driving customer-focused innovation.
• Engage in co-creating state-of-the-art digital solutions.
• Contribute to innovation through a user experience center of excellence focused on customer-centric product development.
• Apply cutting-edge technologies via an artificial intelligence center of excellence for next-generation expert solutions.

Hiring process

• Candidates must participate in interviews without the assistance of AI tools or external prompts.
• Removal of virtual backgrounds is requested during interviews.
• In-person interviews are included in the hiring process.
• Applicants may be required to appear onsite at a hirify.global office.