Назад
Company hidden
6 дней назад

Senior Technical Product Manager, Agent Builder (AI)

195 000 - 220 000$
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Senior Technical Product Manager, Agent Builder (AI): Owning the Agent Builder platform that enables audit and finance firms to create, evaluate, publish, observe, govern, and retire AI agents with traceable outputs and human review, with an accent on agent harnesses, retrieval, tool calling, and evaluation. Focus on designing feedback loops, regression testing, quality gates, observability, and versioned workflows for production agent systems.

Location: New York City, USA; hybrid work with at least 3 days onsite per week in the New York City office

Salary: $195K–$220K annually, plus equity.

Company

hirify.global builds AI solutions for audit and finance professionals, including Alwin, an agentic automation platform that processes evidence across PDF, Word, and Excel with traceable audit trails.

What you will do

  • Own the Agent Builder strategy, roadmap, and product trade-offs.
  • Design the agent harness with engineering, including context assembly, tool definitions, orchestration, and human review points.
  • Define how builders create multi-step agents using procedures, tools, knowledge sources, thresholds, and approval gates.
  • Build feedback loops that turn run traces and reviewer edits into evaluation cases, regression tests, and approved product improvements.
  • Set quality gates, evaluate new models and methodology versions, and report agent quality using a stated method and sample.
  • Prototype with code, write concise specifications and decision memos, and work with firms to turn field learnings into product capabilities.

Requirements

  • Technical background in software, ML, or infrastructure engineering, or several years as a technical PM for developer or AI platforms.
  • Hands-on experience shipping production agent systems involving context and retrieval, tool calling, orchestration, structured outputs, retries, and fallbacks.
  • Experience building evaluation datasets, calibrating LLM judges against human labels, conducting offline and online evaluation, and regression-testing model versions.
  • Experience with LLM observability, including traces, cost, latency, and failure classification.
  • System design skills covering schemas, versioning, permissions, event logs, and APIs; ability to read and challenge design documents.
  • Product management experience on a product that other people build on.
  • Ability to prototype in code with AI tools as part of normal work.
  • Clear, concise writing skills.

Nice to have

  • Audit or accounting knowledge, or experience building products for auditors, finance teams, or experts in regulated fields.
  • Document AI experience with extraction, OCR, grounding, and citation.
  • Experience building agent harnesses or frameworks, evaluation tooling, or LLM observability.
  • Experience building review workflows or feedback pipelines that convert user corrections into evaluation or training data.
  • Experience with low-code tools, workflow designers, rule engines, or DSLs.
  • Experience running design-partner programmes with large enterprise customers.

Culture & Benefits

  • Hybrid work requires at least 3 days onsite in the New York City office.
  • Equity through Stock Appreciation Rights, flexible paid time off, medical and dental coverage, and a 401K match.
  • Paid parental leave, company-sponsored lunch, and access to mental health and wellness resources.
  • Continuous learning and development initiatives.
  • International collaboration across five global offices and company-wide team-building events.

Hiring process

  • Recruitment screen, 30 minutes online.
  • Hiring manager interview, 30 minutes online; panel presentation, 60 minutes online.
  • Leadership interview and final interview, 30 minutes online each.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →