LLMOps Engineer (LLM)
Вакансия размещена на Hirify напрямую от HR/нанимающего менеджераМэтч
Покажет вашу совместимость с вакансией
Описание вакансии
LLMOps Engineer (Self-hosted LLMs / GPU Infrastructure) - Freelance, Remote
We are looking to connect with engineers who know how to run large language models in production - on our own hardware, not through external APIs.
What you will do:
- Select, benchmark and deploy open-source LLMs (e.g. Llama, Mistral, Qwen) and embedding models
- Serve models in production with vLLM, TGI, Ollama or similar
- Run and optimize GPU infrastructure on-premises and in private cloud
- Tune latency, throughput, memory and cost (quantization, batching, caching)
- Set up monitoring, logging and scaling for model serving
- Work closely with our AI and DevOps engineers to bring RAG and agent systems to production
Must have:
- Hands-on experience running LLMs in production on your own infrastructure (not only via OpenAI/Anthropic APIs)
- Experience with vLLM, TGI, Ollama, Triton or similar serving frameworks
- Solid Linux, Docker and Kubernetes skills, incl. GPU workloads
- Python
- English at B2 level or higher
Nice to have:
- Quantization (GPTQ, AWQ, GGUF) and inference optimization
- Fine-tuning (LoRA / QLoRA)
- Monitoring with Prometheus / Grafana
- Experience with air-gapped or highly secure environments
What we offer:
- Challenging AI projects that help you deepen your expertise and grow your technical skills
- Opportunities to work with modern AI technologies and solve real-world engineering problems
- Long-term collaboration opportunities
- Fully remote work
- A small, experienced team that values engineering quality
How to apply:
Please send
Your CV, LinkedIn/GitHub
A short description of one model deployment you ran: which model, which hardware, how you served it and one problem you solved (a few sentences are enough)
Your daily rate (net) and earliest start date
Your country of residence
Our process: A short intro call to get to know each other. For specific project opportunities, we conduct a live technical session together.
Applicants based in Russia or Belarus cannot be considered.
Ready to apply? Drop us a message on Telegram:
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Вакансия размещена на Hirify напрямую от HR/нанимающего менеджера
