Associate Director AI Product Engineer (Financial Institution Operations & Technology)

Location: Remote - USA. Preferred locations are New York, Chicago, Washington, D.C., Dallas, and Boston; other locations may be considered case by case. Travel to client sites may be required.

Salary: $180,000–$250,000 annually for the Associate Director level.

Company

hirify.global provides consulting, economics, disputes and investigations, corporate finance, performance improvement, and emerging technology services through interdisciplinary teams of consultants, industry experts, academics, and data scientists.

What you will do

• Define evaluation approaches, correctness criteria, error impact, and evidence required before AI products are used in banking operations.
• Build reusable Python-based software for automated tests, scoring, version comparisons, and repeatable result tracking.
• Design representative and unseen test cases, establish pass criteria, measure accuracy and uncertainty, and distinguish defects that should block release.
• Investigate failures by checking extracted facts, amounts, dates, totals, citations, source quality, answer quality, and human-review effectiveness.
• Test safeguards against invented facts, unsupported recommendations, unfair outcomes, sensitive-data disclosure, and attempts to bypass controls.
• Monitor live outputs, document failures and limitations, recommend release or restricted use, and support client approvals, proposals, estimates, mentoring, and recruiting.

Requirements

• At least 5 years of professional experience, including at least 1 year of AI evaluation experience.
• Ownership of AI evaluations that informed real release decisions, including test design, expert-reviewed answers, scoring, and failure investigation.
• Strong Python skills and experience building automated test software, connecting data sources, and recording repeatable results across product versions.
• Ability to select representative samples, interpret error rates and uncertainty, and distinguish genuine improvement from weak tests or inconsistent scoring.
• Experience building or improving AI products used in operations, with practical controls for sensitive data, output accuracy, and human review.
• Experience in financial services or another regulated environment, translating business requirements into practical tests and controls.
• Strong communication and teamwork skills, ability to mentor colleagues, and willingness to travel to client sites as needed.
• Must be able to verify legal authorization to work in the United States without employer sponsorship now or in the future.

Nice to have

• Banking experience in lending, payments, servicing, collections, or default operations.
• Experience independently evaluating AI products, comparing automated scoring with expert judgment, or testing security and fairness in financial institutions.
• Experience evaluating document review, summaries, information search, or automated workflows across AI services and conventional software.
• Consulting or product delivery experience, including client discovery, implementation planning, and user adoption.

Culture & Benefits

• Full-time employment in a consulting environment combining banking expertise, technology, and AI.
• Work is remote within the USA, with preferred locations and case-by-case location consideration.
• Travel to client sites may be required.
• The role supports interdisciplinary collaboration among consultants, industry experts, academics, and data scientists.