Manager, AI Ops Site Reliability Engineer

Location: Thessaloniki, Chortiatis, Greece. Work arrangement: Hybrid. Periodic international and domestic travel required, less than 10%.

Company

hirify.global is a global pharmaceutical company developing medicines and digital solutions to improve health outcomes and transform drug discovery and development.

What you will do

• Design AI agent workflows for incident intake and investigation, including prompts, context, retrieval, tool selection, and decision logic.
• Build and own evaluation harnesses using historical incidents, ground-truth datasets, accuracy metrics, regression tests, and hallucination detection.
• Define reasoning guardrails, confidence thresholds, approval rules, and human-deference conditions for operations agents.
• Convert operational runbooks and investigations into retrievable, machine-usable knowledge in collaboration with domain experts.
• Redesign operational workflows with agent assistance, pilot them, and measure toil and MTTR reduction.
• Continuously tune agent quality against production results while collaborating with SRE, operations, platform, and AI Ops teams.

Requirements

• Bachelor's degree in a technical field or equivalent practical experience.
• 4+ years of experience in software, data, or ML/AI engineering, including production delivery of LLM or agent-based applications.
• Experience with prompt and context engineering and structured AI evaluations, including ground-truth datasets, metrics, and regression testing.
• Working knowledge of agent frameworks and tooling such as Amazon Bedrock AgentCore or LangGraph, RAG, knowledge-base design, and strong Python skills.
• IT operations literacy and the ability to assess the plausibility of agent outputs in operational workflows.
• Strong analytical and communication skills, with experience collaborating with SREs and presenting accuracy results.

Nice to have

• Experience with LLM-as-judge evaluation.
• Familiarity with ServiceNow, Dynatrace, or observability data.
• Experience working in an agile environment.

Culture & Benefits

• Flexible workplace culture designed to support work-life harmony.
• Collaborative environment focused on continuous improvement and digital transformation.
• Periodic domestic and international travel of less than 10%.
• Inclusive workplace with support for reasonable disability accommodations.