Назад
Company hidden
11 часов назад

Applied AI Engineer

105 000 - 165 000$
Формат работы
remote (только USA)
Тип работы
fulltime
Грейд
senior
Английский
b2
Страна
US
Вакансия из списка Hirify.GlobalВакансия из Hirify Global, списка международных tech-компаний
Для мэтча и отклика нужен Plus

Мэтч & Сопровод

Для мэтча с этой вакансией нужен Plus

Описание вакансии

Текст:
/
TL;DR
Applied AI Engineer (Python/Java/LLM): Building and operating AI-powered consumer features, evaluation frameworks, and safety tooling for credit insights and chat assistants with an accent on prompt engineering, production LLM evaluation, guardrails, and compliance. Focus on measuring evaluator quality against human labels, reducing model cost and latency, and shipping model upgrades safely through regression testing and A/B experiments.

Location: Work from Home, United States

Targeted base pay range: $105,000–$165,000 per year

Company

hirify.global is a global analytics software company whose solutions help businesses in more than 100 countries make data-driven decisions across credit scoring, fraud detection, lending, and other areas.

What you will do

  • Own system prompts, tool descriptions, and evaluation prompts for Personalized Credit Insights and the AI chat assistant.
  • Build evaluation frameworks that convert production failures into test cases, run regression suites, and report trusted results.
  • Design and monitor guardrails, including classifiers, PII redaction, prompt-injection defenses, and financial-advice compliance rules with Legal and Compliance.
  • Lead model upgrades by comparing quality, cost, and latency and releasing changes through A/B tests.
  • Improve cost and latency through prompt caching, model routing, and context management.
  • Build transcript viewers, labeling workflows, dashboards, and other tools for Conversation Analysts and QA engineers while partnering on fairness and bias evaluation.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, with professional software engineering experience.
  • Strong Python skills and the ability to read and contribute to Java Spring Boot microservices.
  • Production experience building and operating LLM-powered applications, including prompt design, tool calling, structured outputs, and streaming.
  • Experience building LLM evaluations, including test sets, regression suites, LLM-as-judge approaches, and evaluator-quality measurement against human labels.
  • Working knowledge of Amazon Bedrock or a comparable managed LLM platform, plus AWS S3, Lambda, and DynamoDB.
  • Proficient SQL and experience analyzing production data in a warehouse such as Amazon Redshift.
  • Production ownership experience covering code review, CI/CD, release management, and on-call support in Agile/Scrum teams.
  • Strong written and verbal communication skills, including the ability to explain evaluation results and tradeoffs to product, legal, and executive stakeholders.

Nice to have

  • Experience with guardrail tooling, LLM security testing, RAG and retrieval evaluation, fairness and bias evaluation, model migrations, Datadog, Tableau, or regulated domains such as FCRA, ECOA, UDAAP, and CFPB guidance.

Culture & Benefits

  • Inclusive, people-first culture centered on ownership, customer focus, and respect.
  • Professional development through learning experiences and opportunities to use individual strengths.
  • Competitive compensation, benefits, and rewards programs.
  • Work/life balance, employee resource groups, and social events.

Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →