Senior AI Engineer (Observability)

TL;DR

Senior AI Engineer (Observability): Building scalable AI infrastructure and observability solutions for a cloud platform with an accent on reliable performance and intelligent system monitoring. Focus on enhancing a secure, cloud-based board management platform with intuitive meeting tools, real-time collaboration, and advanced analytics.

Location: Albania, Austria, Azerbaijan, Belarus, Belgium, Bosnia and Herzegovina, Bulgaria, Croatia, Cyprus, Czech Republic, Denmark, Estonia, Finland, France, Georgia, Germany, Hungary, Italy, Kazakhstan, Kosovo, Kyrgyzstan, Latvia, Lithuania, Luxembourg, Montenegro, Norway, Poland, Portugal, Romania, Serbia, Slovakia, Slovenia, Spain, Sweden, Switzerland, The Netherlands, The Republic of Moldova, Turkmenistan

Salary: EUR 2800 - 4550 per month (gross). Final compensation depends on experience and location and professional growth.

Company

hirify.global delivers professional and technology-enabled solutions that support effective collaboration, structured communication, and operational efficiency for organizations.

What you will do

• Translate product requirements into AI workflows and quality criteria.
• Design, implement, and optimize prompts using LangFuse.
• Build evaluation datasets from real customer scenarios.
• Establish quality gates and measurement systems (precision, recall, accuracy).
• Set up and maintain LangFuse for observability and prompt experimentation.

Requirements

• Experience in software engineering for 5+ years, including delivering production systems.
• Bachelor's degree in computer science, Engineering, IT, or equivalent experience.
• Experience with LLM-powered features or AI pipelines (instrumentation, evaluation, or monitoring).
• Experience with LLMOps and observability tools (e.g., Langfuse, Arize, W&B, LangSmith).
• Understanding RAG, prompt engineering, vector search, and orchestration frameworks (e.g., Semantic Kernel, LangChain).
• Level of English – from Intermediate+ and above.

Nice to have

• Experience with A/B testing or online experimentation frameworks applied to AI features.
• Familiarity with OpenTelemetry and its emerging application to LLM tracing (OpenLLMetry or similar).
• Experience monitoring guardrail and content safety systems — including tracking filter effectiveness, policy enforcement, and safety-related anomalies as a distinct observability concern.

Culture & Benefits

• Work with leaders in FinTech, Healthcare, Retail, Telecom, and others.
• Opportunity to change the project and/or develop expertise in an interesting business domain.
• Work fully remotely, from the office, or choose a hybrid variant.
• Access to the corporate training portal.
• Bright corporate life and certification compensation.
• Private health insurance and compensation for sports activities.