Назад
Company hidden
1 день назад

Senior AI Engineer — Agent Platform and Evaluation

Формат работы
onsite
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
Israel/Bulgaria
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior AI Engineer — Agent Platform and Evaluation (AI agents, Python, AWS Bedrock): Building and extending production AI agents, evaluation harnesses, telemetry, retrieval, and runtime infrastructure with an accent on agent behavior, model evaluation, and production reliability. Focus on migrating from self-managed Kubernetes to Bedrock AgentCore, governing model spend, and designing retrieval and observability systems for long-running workflows with human approval gates.

Location: Sofia or Israel

Company

hirify.global is a global software and infrastructure company operating a high-performance trading platform and a marketing/CRM platform while consolidating and modernizing its systems.

What you will do

  • Build new AI agents and extend agents already operating against production codebases.
  • Develop agent tools and the context architecture governing agent behavior.
  • Build an evaluation harness that detects regressions before changes merge.
  • Implement telemetry to measure agent value and budgets to govern model spend.
  • Develop the retrieval layer for targeted repository and codebase access.
  • Own the second half of the migration from self-managed Kubernetes to AWS Bedrock AgentCore.

Requirements

  • Experience with Python across service and agent codebases.
  • Experience with Temporal for multi-stage pipelines lasting hours and including human approval gates.
  • Experience with LangGraph and Claude Code agent runtimes.
  • Experience with AWS Bedrock and LiteLLM.
  • Experience with Langfuse for LLM traces and evaluation.
  • Experience with OpenTelemetry, Prometheus, and Grafana.
  • Experience with PostgreSQL and pgvector for memory and caching.
  • Experience with MCP servers for tools and Azure DevOps Repos and Pipelines for delivery.

Nice to have

  • Experience in startup environments.

Culture & Benefits

  • Position is available to candidates in Sofia or Israel.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →