DevOps Engineer (AI)

TL;DR

DevOps Engineer (AI): Designing and maintaining the infrastructure for a next-generation AI Customer Care platform with an accent on low-latency speech-to-speech pipelines and container orchestration. Focus on scaling AI agentic workflows, optimizing distributed systems, and integrating state-of-the-art LLM orchestration frameworks.

Location: Hybrid in Karlsruhe, Germany

Company

hirify.global is a leading European provider of cloud infrastructure, cloud services, and hosting services for small and medium-sized businesses.

What you will do

• Design, build, and maintain CI/CD pipelines while automating infrastructure provisioning and configuration.
• Redesign and optimize infrastructure toward container orchestration using Debian-based Linux systems.
• Architect low-latency streaming infrastructure for Speech-to-Speech (S2S) pipelines to ensure sub-500ms round-trip latency.
• Host and maintain specialized AI tooling, including MCP servers, Vector store databases, and caching applications.
• Ensure high availability, observability, and monitoring across multiple data centers using Prometheus, Grafana, and ELK.
• Implement and maintain ISO security standards, handling vulnerabilities and dependency tracking.

Requirements

• Strong Linux administration experience, specifically with Debian-based systems.
• Hands-on production experience with Kubernetes and cloud-native architectures.
• Solid understanding of networking fundamentals, including subnetting, routing, and BGP concepts.
• Proficiency in scripting with Bash, Python, or similar languages.
• Experience with Infrastructure-as-Code (Terraform), CI/CD (Gitlab/Github CI, Jenkins), and container tools (Docker, Helm, ArgoCD).
• Knowledge of security best practices including OpenID Connect, OAuth 2, Hashicorp Vault, and Keycloak.

Nice to have

• Experience with telephony gateways (Twilio, Amazon Connect) and SIP/RTP protocols.
• Experience migrating from VM-based infrastructure to container orchestration.
• Exposure to AI-driven development workflows.

Culture & Benefits

• Hybrid work option and flexible work schedule.
• Medical services package from private providers.
• Access to local and international trainings and e-learning platforms for technical and soft skills.
• 25 vacation days per year plus substitute days off for public holidays.
• Meal tickets and a variety of team events, including Summerfest and Winterfest.
• Office perks including free coffee, soft drinks, and fresh fruits.