Staff Machine Learning Engineer (AI Applications)

TL;DR

Staff Machine Learning Engineer (AI Applications): Leading the quality, learning, and knowledge foundations for the customer support AI automation stack with an accent on LLM evaluation, RAG, and feedback loops. Focus on building scalable knowledge mining capabilities, defining evaluation strategies, and aligning AI behavior with business goals.

Location: Hybrid (Warsaw, Poland) — minimum 2 days in the office each week

Company

hirify.global is one of the fastest-growing tech companies in Europe and Africa, aiming to make cities for people, not cars.

What you will do

• Lead the alignment of Customer Support AI behavior with business goals, customer experience standards, and policy requirements.
• Build and scale knowledge mining capabilities to convert conversations and operational data into reusable knowledge assets.
• Own the evaluation strategy for LLM-powered systems, including offline benchmarks, golden datasets, and production quality metrics.
• Develop feedback loops connecting production failures and human corrections to improve prompts, retrieval, and model behavior.
• Partner with AI infrastructure engineers to improve tool-use quality, routing behavior, and multi-step task performance.
• Influence the technical roadmap by clarifying trade-offs in model behavior, retrieval quality, and business impact.

Requirements

• Hands-on experience with retrieval-augmented generation (RAG), search, ranking, or knowledge-based AI applications.
• Experience working in knowledge-heavy or policy-constrained domains where correctness and trust are critical.
• Proven ability to build feedback loops from user behavior, QA signals, or annotations into system improvements.
• Capability to operate at both strategic and hands-on levels, including data analysis and failure analysis.
• Strong communication and stakeholder management skills to align engineering, product, and operations.

Nice to have

• Experience with LLM-based pipelines or agentic AI systems.
• Expertise in tool use, routing, memory, multi-step reasoning, or human-AI orchestration.

Culture & Benefits

• Rewarding salary and stock option package.
• Flexible hybrid work model with a minimum of 2 days in the office per week.
• Wellness perks for physical and mental health.
• Opportunity to work in fast-moving autonomous teams with high impact on millions of customers.
• Professional growth opportunities within a global company operating in 50+ countries.