Senior AI Developer (Python)

TL;DR

Senior AI Developer (Python): Building a next-generation multimodal AI platform for customer support with an accent on agentic workflows, RAG/CAG pipelines, Speech-to-Speech interactions, and hybrid LLM integration. Focus on designing low-latency real-time systems, optimizing context retrieval, and developing automated QA modules for continuous improvement and alignment.

Location: Karlsruhe (Hybrid work option)

Company

Leading European provider of cloud infrastructure, hosting services, and digitalization solutions for SMBs, operating in 18 markets.

What you will do

• Design and implement LLM-based agentic workflows with tool usage, orchestration, and secure interactions via Model Context Protocol (MCP).
• Build and optimize Retrieval-Augmented Generation (RAG) and Context-Augmented Generation (CAG) pipelines for accurate, low-latency responses.
• Develop real-time Speech-to-Speech (S2S) pipelines, focusing on streaming architectures and latency reduction.
• Create automated QA and evaluation modules using LLM-as-a-judge patterns to measure and improve accuracy, safety, and resolution quality.
• Integrate and manage hybrid models from commercial providers (OpenAI, Anthropic) and open-source alternatives (Qwen, DeepSeek).

Requirements

• Advanced Python skills, including async programming (FastAPI, asyncio) and high-performance services
• Experience with LLM applications, multi-agent orchestration (LangChain, LlamaIndex, LangGraph)
• Deep knowledge of vector databases (Weaviate, Qdrant, pgvector), semantic search, and RAG optimization
• Real-time systems experience with low-latency streaming APIs and event-driven architectures
• Evaluation frameworks for LLMs, including automated QA pipelines
• RESTful API design and OAuth2 knowledge

Culture & Benefits

• Flexible work schedule and hybrid work option
• 25 vacation days + substitute days for weekend holidays
• Medical services package, meal tickets, and office perks (coffee, fruits)
• Access to trainings, e-learning platforms for technical and soft skills
• Team events, networking, Summerfest, and Winterfest parties
• Modern technologies, product responsibility, and flat hierarchies