AI Platform Engineer

Location: Europe; remote work is available

Company

hirify.global is hiring an AI Platform Engineer to build internal infrastructure for LLM and agent adoption.

What you will do

• Architect, build, and operate an internal LLM Gateway with routing, rate limiting, quotas, cost tracking, and automated fallbacks.
• Design and build an agent control plane for agent creation, context management, task execution, and state tracking.
• Build and maintain internal SDKs and integrate relevant open-source tools.
• Implement observability, monitoring, alerting, tracing, and evaluation for LLM and agent workflows, including latency, token usage, costs, and failovers.
• Implement security and governance for LLM usage and AI agents.
• Collaborate with internal teams to translate business needs into AI solutions and drive AI adoption.

Requirements

• 5+ years of backend development experience.
• Strong proficiency in Python or another modern backend language such as Go, TypeScript, or Rust, with willingness to use Python as the primary platform language.
• Deep understanding of distributed systems, including async queues, rate limiting, retries, circuit breakers, and failover mechanics.
• At least 1 year of hands-on experience with AI/LLM-based solutions.
• Practical experience with LLM APIs such as OpenAI, Anthropic, or Gemini, including streaming, tool calling, context management, and rate limits.
• Hands-on experience building AI agents or agentic workflows.
• Knowledge of observability covering metrics, logs, and tracing.
• Experience with Docker, Kubernetes, and cloud platforms such as AWS or GCP.
• Strong logical thinking, ownership, initiative, product mindset, and English at Intermediate level or higher.

Nice to have

• Experience building developer platforms, internal tooling, API Gateways, or SDKs.
• Experience with MCP, RAG pipelines, or vector databases.
• Experience with LLM observability and evaluation tools such as Langfuse, LangSmith, or OpenTelemetry.
• Active personal adoption of AI tools or agents to automate workflows.
• Degree in Computer Science, Software Engineering, or a related field.

Culture & Benefits

• Remote work opportunity in Europe.
• 20 paid vacation days and 10 paid sick leave days per year.
• Public holidays according to the company's approved holiday list.
• Medical insurance.
• Professional education, language learning, and wellness budgets.

Hiring process

• Apply for the AI Platform Engineer position.