Назад
Company hidden
1 день назад

Manager, AI Ops Site Reliability Engineer

31 125€
Формат работы
hybrid
Тип работы
fulltime
Грейд
middle
Английский
b2
Страна
Ireland/Greece
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Manager, AI Ops Site Reliability Engineer (AI/LLM Operations): Designing reliable AI agent workflows and evaluation systems for operational incident investigation with an accent on prompt and context engineering, retrieval, and measurable accuracy. Focus on building ground-truth datasets, regression tests, reasoning guardrails, and agent-assisted workflows that reduce toil and MTTR.

Location: Hybrid, Greece-Thessaloniki Chortiatis or Ireland-Dublin-Ringsend. Periodic international and domestic travel required, less than 10%.

Annual base salary: €31,125 for the Greece-Thessaloniki Chortiatis location.

Company

hirify.global develops medicines and applies data, modeling, and automated solutions to accelerate drug discovery and development and improve health outcomes.

What you will do

  • Design agent workflows for incident intake and investigation, including prompts, context, retrieval, tool selection, and decision logic.
  • Build and own evaluation harnesses using historical incident datasets, accuracy, precision and recall metrics, regression tests, and hallucination detection.
  • Define reasoning guardrails, confidence thresholds, and human-deference rules for agent outputs.
  • Convert operational runbooks and investigations into retrievable knowledge in collaboration with domain experts.
  • Redesign operational workflows as agent-assisted processes, pilot them, and measure toil and MTTR reduction.
  • Tune agent quality against production results and collaborate with SRE, Ops, Platform, and AI Ops stakeholders.

Requirements

  • Bachelor's degree in a technical field or equivalent practical experience.
  • 4+ years of experience in software, data, or ML/AI engineering, including hands-on delivery of LLM or agent-based applications in production.
  • Experience with prompt and context engineering and structured AI evaluations, including ground-truth sets, metrics, and regression testing.
  • Working knowledge of agent frameworks and tooling, such as Amazon Bedrock AgentCore or LangGraph, and RAG or knowledge-base design.
  • Strong Python skills.
  • IT operations literacy sufficient to design realistic workflows and assess the plausibility of agent output.
  • Strong analytical and communication skills for working with SREs, extracting knowledge, and presenting accuracy results.
  • Experience in an agile work environment, with collaboration, adaptability, and proactive problem-solving.

Nice to have

  • LLM-as-judge evaluation experience.
  • Familiarity with ServiceNow, Dynatrace, or observability data.

Culture & Benefits

  • Hybrid work location with a flexible workplace culture focused on work-life harmony.
  • Benefits may include healthcare coverage, retirement savings plans, insurance, employee assistance, and wellness programs; benefits vary by location.
  • Work supports hirify.global's values of courage, joy, equity, and excellence and its patient-centric mission.
  • hirify.global promotes an inclusive workplace and provides reasonable adjustments for candidates with disabilities.

Hiring process

  • Apply by sending a CV in English.
  • Local pay information for secondary posting locations subject to pay transparency regulations will be shared during the first interview.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →