Inference Systems Engineer (AI)

Location: Remote within the EU

Company

hirify.global builds unified general intelligence systems that generate, understand, and operate in the physical world, with a focus on multimodal AI and vision.

What you will do

• Integrate new model architectures into the inference engine.
• Optimize model efficiency, deployments, and inference workflows in collaboration with research, engineering, and infrastructure.
• Build tooling to measure, profile, and track inference jobs and workflows.
• Automate, test, and maintain inference services for high uptime and reliability.
• Manage inference workloads across clusters and hardware providers, scaling deployments across thousands of machines.
• Build GPU scheduling systems that meet SLOs and maintain CI/CD for model checkpoints and SDKs.

Requirements

• Strong Python and systems architecture skills.
• Experience deploying models with PyTorch, Hugging Face, vLLM, SGLang, TensorRT-LLM, or similar technologies.
• Experience with queues, scheduling, traffic control, and fleet management at scale.
• Experience with Linux, Docker, Kubernetes, orchestration, deployment, and scheduling.
• Familiarity with Redis and S3-compatible storage.

Nice to have

• Experience with RDMA, RoCE, InfiniBand, or NVLink.
• Experience with high-performance large-scale ML systems using 100 or more GPUs.
• Experience with CUDA, FFmpeg, or multimedia processing.

Culture & Benefits

• Remote work within the EU.
• Cross-functional collaboration across research, engineering, and infrastructure.
• Work focused on large-scale AI inference, GPU utilization, and production reliability.
• Equal opportunity employment.