Senior MLOps / LLMOps Engineer (AI)

TL;DR

Senior MLOps / LLMOps Engineer (AI/MLOps): Building and operating scalable ML and LLM-based systems in production with an accent on self-hosted models, evaluation frameworks, and platform reliability. Focus on designing LLM Gateway services, implementing MCP-compatible services, and optimizing the generative AI lifecycle.

Location: Hybrid (Berlin, Germany) — three days of on-site work per week required. Relocation support available.

Company

hirify.global is Germany’s leading digital ecosystem for the real estate market, connecting homeowners, seekers, and agents.

What you will do

• Design and maintain scalable ML/LLM infrastructure and pipelines on AWS.
• Productionize traditional ML and generative AI solutions in collaboration with cross-functional product teams.
• Own the ML/LLMOps lifecycle, including prompting, deployment, monitoring, evaluation, and optimization.
• Build and evolve an LLM Gateway service to standardize access, routing, and governance.
• Develop evaluation frameworks to measure the quality, performance, and reliability of LLM outputs.
• Implement MCP-compatible services to enable standardized context exchange between LLMs, tools, and data sources.

Requirements

• Strong experience in MLOps (CI/CD, Docker, Kubernetes) and operating production-grade systems.
• Proficiency in Python and solid software engineering and scalable system design skills.
• Hands-on experience with LLMs and generative AI technologies (e.g., GPT, Gemini, or Anthropic).
• Expertise in prompt engineering, agent orchestration, context management, and output validation.
• Experience with LLM evaluation frameworks and deploying self-hosted LLMs.
• Familiarity with cloud platforms (AWS, GCP) as well as DevOps, testing, and observability practices.

Culture & Benefits

• Hybrid work model with 3 days on-site and 30 days of annual vacation.
• Possibility to work from abroad for 10 days per year.
• Full relocation support including visa processing and an attractive relocation package.
• Dedicated learning time, online courses via ScoutAcademy, and structured career paths.
• Comprehensive office perks: on-site gym, napping room, rooftop terrace, and dog-friendly environment.
• Family support services for childcare and subsidized public transport or Job Bikes.