Назад
Company hidden
1 день назад

Machine Learning Engineer (AI)

180 000 - 250 000$
Формат работы
hybrid
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Machine Learning Engineer (AI/Fintech): Building and shipping LLM-powered agentic systems and evaluation infrastructure for financial institutions with an accent on production reliability, distributed systems, and trustworthy measurement. Focus on designing evaluation datasets and metrics, analyzing agent failure modes, and scaling backend pipelines, queues, and services.

Location: Hybrid role based out of the San Francisco, CA or New York, NY office; in-office work is required on Mondays, Wednesdays, and Fridays.

Base pay: $180,000–$250,000 per year, plus equity for full-time roles; benefits, bonuses, and applicable commission plans may also apply.

Company

hirify.global builds AI agents for banks, credit unions, fintechs, and processors to automate disputes, fraud, collections, claims, payments, and chargebacks.

What you will do

  • Design and build evaluation systems for LLM and agentic workflows, including datasets, metrics, automated graders, LLM-as-judge systems, and regression suites.
  • Productionize evaluation systems for reliable operation at scale, in CI, and against live traffic.
  • Build agentic systems end to end, including tool use, planning, orchestration, memory and context management, and failure handling.
  • Analyze agent behavior and failure modes and improve prompts, tools, architectures, and evaluations.
  • Build and scale backend distributed systems such as pipelines, queues, and services.
  • Partner on classical ML systems, taking models from design through production and maintaining their health; contribute through code reviews, design documentation, and knowledge sharing.

Requirements

  • Experience building and operating distributed systems or production backend services, with strong reasoning about scale, reliability, and latency.
  • Experience evaluating LLM or agentic systems in production, including building evaluation harnesses, defining metrics, curating golden cases, and using results to drive product decisions.
  • Experience building and shipping LLM-based or agentic systems in production, with an understanding of their reliability and failure modes.
  • Experience training and deploying classical ML models, including problem framing, feature development, validation, and monitoring.
  • Ability to own ambiguous problems from idea through production and communicate tradeoffs clearly.

Nice to have

  • Experience building agent evaluation infrastructure, including trajectory-level evaluations, simulated environments, and online/offline evaluation parity.
  • Experience with workflow orchestration and large-scale data processing frameworks.
  • Familiarity with human-in-the-loop labeling and annotation workflows for building evaluation sets.
  • Open-source contributions or published work related to LLMs, agents, or evaluation.

Culture & Benefits

  • Full-time employment with startup equity and flexible paid time off.
  • Full health, vision, and dental coverage, One Medical membership, and a 401(k) with match.
  • Apple equipment, an annual home office budget, commuter benefits, stocked kitchens, and lunches.
  • Team-building events and happy hours.

Будьте осторожны

Если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого. Это мошенники. Обязательно жмите «Пожаловаться» или пишите в поддержку. Подробнее в гайде →