Senior DevOps Engineer (Industrial AI Cloud)

TL;DR

Senior DevOps Engineer (Industrial AI Cloud): Guide enterprise customers through onboarding, training, and adoption of NVIDIA GPU-based AI platform with an accent on GPU infrastructure, AI/ML model training, and platform integration. Focus on designing PoCs, optimizing LLM inference, and implementing automation for reliable AI workloads.

Location: Košice, Slovakia. Remote working possible only within Slovakia due to taxation regulations.

Salary: from 2,600 € brutto (negotiable) + variable part + 3,000 € sign-on bonus.

Company

hirify.global, a major employer in Košice IT Valley with over 3,900 employees, developing industrial AI cloud infrastructure with NVIDIA.

What you will do

• Consult customers on GPU infrastructure, AI/ML training, and platform usage.
• Lead onboarding, training, and mentoring on optimal GPU cluster and AI environment usage.
• Design and implement PoCs including environment setup, data pipelines, and deployment workflows.
• Perform requirement engineering, translating business needs to technical specs.
• Optimize performance, troubleshoot, fine-tune, and validate AI solutions.
• Coordinate cross-functional teams and develop automation concepts for services and processes.
• Apply best practices in reliability, scalability, responsible AI, security, monitoring, and capacity planning.

Requirements

• Master’s degree in IT, Computer Engineering, Applied AI, or related.
• Strong knowledge of NVIDIA GPU platforms (DGX, B200, RTX Pro Servers).
• Experience with self-hosted LLMs, fine-tuning, and inference optimization.
• Hands-on with Slurm, Run:AI or GPU schedulers; advanced Linux admin.
• Kubernetes, IaC (Ansible, Terraform, Helm), SDN, monitoring (Prometheus, Grafana).
• Scripting (Python, Bash); data engineering tools; English C1 required, German advantage.
• Customer-facing communication, requirement engineering, testing, analytical skills.

Nice to have

• LLM architectures, embeddings, vector DBs, RAG pipelines, prompt engineering.
• Responsible AI practices; AI/ML frameworks (PyTorch, TensorFlow, Hugging Face, Triton).

Culture & Benefits

• Extensive work-life balance portfolio with over 25 benefits for health, family, learning, development.
• Financial benefits, variable pay, focus on physical/mental well-being.
• Positive work environment promoting career growth and personal lifestyle flexibility.