Technical Lead, Senior AI Engineer (AI)

Location: Hybrid working from Warsaw or Kraków, Poland

Company

hirify.global is part of InPost Group, a European out-of-home delivery company operating intelligent parcel-locker networks and consumer e-commerce products.

What you will do

• Own the LLM-as-judge pipeline for release gating across real and golden conversations.
• Build and maintain evaluation datasets and a Polish-language golden set covering key intents and categories.
• Develop diagnostic conversation mining and root-cause analysis based on a stable issue taxonomy.
• Build detection for abusive, adversarial, and anomalous sessions alongside guardrails and red-team work.
• Define measurable quality requirements with product and business stakeholders and present actionable results.
• Set technical direction, review platform work, mentor engineers, and coordinate scope with the PM and EM.

Requirements

• At least 5 years of building and running production software, including at least 2 years working with LLM-based systems used by real users.
• Strong production engineering fundamentals, including testing, CI/CD, containers, observability, cloud, and Python.
• Hands-on experience evaluating generative systems using LLM-as-judge methods, human-label calibration, inter-annotator agreement, regression suites, and offline-versus-online analysis.
• Knowledge of prompt and context engineering, structured outputs, failure-mode taxonomies, agentic primitives, tool use, multi-turn state, MCP, and LLM observability tooling.
• Experience with SQL, data at scale, and reproducible metrics, plus fluency with AI-assisted development tools such as Claude Code, Cursor, or Copilot.
• English at B2 level and Polish are required.

Nice to have

• Experience building agent loops, retries, fallbacks, tool-call orchestration, deterministic replay, and testable model scaffolding.
• Experience creating auto-improving systems that turn production signals into evaluation cases and product changes.
• Adversarial robustness, jailbreak testing, red-teaming, abuse or fraud detection experience.
• E-commerce, search, or recommendation domain experience.

Culture & Benefits

• Work on a production AI product already used by millions of customers.
• Access to frontier models across multiple providers and an internally maintained open-source track.
• Ownership of a greenfield evaluations platform with production traffic and executive attention.
• Flexible hours, training opportunities, and a range of employee benefits.
• B2B contract offered.