11 часов назад
AI Platform Engineer
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
AI Platform Engineer (LLM/Cloud Infrastructure): Building and maintaining an internal AI provisioning platform for scalable generative AI applications with an accent on model access, observability, governance, and cost control. Focus on securing LLM integrations, implementing telemetry and alerting, and supporting reliable agentic workflows in production.
Location: Berlin, Germany
Company
is a European digital investment and banking platform offering brokerage, wealth management, lending, private equity, and financial infrastructure services.
What you will do
- Develop and maintain an internal AI provisioning platform for access to LLMs and MCP servers.
- Implement LLM observability, logging, telemetry, and alerting with tools such as Datadog and Langfuse.
- Enforce model governance covering security, data privacy, rate limiting, and API cost management.
- Collaborate with embedded AI Software Engineers on cloud-native architectures and agentic workflow integrations.
- Build and maintain infrastructure for monitoring the reliability and performance of production AI systems.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
- Several years of professional experience in Platform Engineering, DevOps, SRE, or backend software development.
- Strong experience with cloud infrastructure, preferably AWS, and Infrastructure as Code with Terraform.
- Proficiency in Python, Go, or another programming language, plus experience with CI/CD pipelines and containerization such as Docker.
- Understanding of API cost management, rate limiting, security best practices, and data privacy for AI models.
- Experience with or willingness to learn LLM gateways, observability platforms, and telemetry, including LiteLLM, Langfuse, and Datadog.
Nice to have
- Experience working as an embedded platform expert in a cross-functional Data Science and AI team.
Culture & Benefits
- International, diverse, inclusive team and an ego-free working environment.
- Latest hardware and tools.
- Knowledge-sharing sessions, career development opportunities, and an individual education budget.
- Free German language classes and international relocation support if required.
- Opportunity to work from abroad.
- Company pension scheme, Deutschland Jobticket contribution, PRIME+ Broker subscription, and discounted sports activities.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →