Senior MLOps/LLMOps Engineer (AI)

TL;DR

Senior MLOps/LLMOps Engineer (AI): Build and operate scalable ML and LLM-based systems in production with an accent on self-hosted models, evaluation frameworks, and platform reliability. Focus on designing LLM gateway services, MCP integrations, observability, and cost-efficient workflows for multi-modal generative AI solutions.

Location: Berlin (hybrid model with three days of on-site work per week)

Company

hirify.global is home to Immohirify.global, Germany’s #1 real estate platform revolutionizing the market in Germany and Austria by building a digital ecosystem for homeowners, seekers, and agents.

What you will do

• Design and maintain scalable ML/LLM infrastructure and pipelines
• Productionize traditional ML and generative AI solutions with cross-functional product teams
• Own the ML/LLMOps lifecycle: prompting, deployment, monitoring, evaluation, and optimization
• Build and evolve an LLM Gateway service to standardize access, routing, and governance
• Develop evaluation frameworks to measure quality, performance, and reliability of LLM outputs
• Design MCP-compatible services and integrate into platforms for tool use, retrieval, and agent-based workflows
• Work with AWS, integrate self-hosted open-source AI models, and ensure observability, cost efficiency, and performance
• Contribute to project management, stakeholder communication, and cross-team collaboration

Requirements

• Located in Berlin or willing to relocate (relocation support provided)
• Strong experience in MLOps (CI/CD, Docker, Kubernetes) and operating production-grade systems
• Proficiency in Python and solid software engineering and scalable system design skills
• Hands-on experience with LLMs and generative AI technologies (e.g., GPT, Gemini, or Anthropic-like models)
• Expertise in prompt engineering, agent orchestration, context management, and output validation
• Experience with LLM evaluation frameworks and deploying self-hosted LLMs
• Familiarity with cloud platforms (e.g., AWS, GCP) as well as DevOps, testing, and observability practices
• Strong communication skills and ability to collaborate with cross-functional teams and stakeholders

Culture & Benefits

• Hybrid work model with 30 days vacation and flexibility to organize remote days
• Work from abroad up to 10 days per year, subject to business needs
• Competitive salary package with bonus, company pension scheme, and subsidies
• Dedicated learning time, ScoutAcademy courses, book challenges, feedback, and career development
• Office perks including gym, napping room, rooftop terrace, organic coffee, cafeteria, massages, and dog-friendly policy
• Family support, mobility subsidies, health coaching, sustainability initiatives, and DEI focus