Senior AI Product Engineer (LLM)

Location: NYC-Metro; hybrid work required

Base compensation: $200,000–$280,000 annually, plus annual bonus and equity.

Company

hirify.global builds production-ready agentic AI systems that automate financial-services workflows within institutional controls and audit boundaries.

What you will do

• Design and deploy LLM-powered agents and RAG systems for complex credit workflows, including prompt design, tool use, orchestration, and evaluation.
• Work directly with technical and non-technical stakeholders at private equity, private credit, and insurance firms to identify workflow problems and co-develop AI solutions.
• Architect and maintain backend systems and APIs connecting data sources and customer platforms.
• Optimize agentic systems for accuracy, latency, reliability, cost, and explainability through rigorous experimentation.
• Define technical architecture and build reusable infrastructure for agent deployment.
• Help establish engineering standards, hiring expectations, and the long-term technical roadmap.

Requirements

• 8–10+ years of software engineering experience.
• At least 2 years of hands-on experience building LLM-based agents or RAG systems in production.
• Experience logging, evaluating, and optimizing AI applications.
• Proficiency in Python and experience with modern AI/ML frameworks, APIs, and cloud infrastructure, preferably GCP.
• Strong understanding of system architecture, performance, and scaling.
• Clear communication skills for ambiguous, high-stakes engineering problems.

Nice to have

• Experience with human-in-the-loop systems, feedback loops, and long-horizon agentic task execution.
• Background in financial systems, risk modeling, or decision automation.
• Familiarity with PydanticAI, LlamaIndex, Google ADK, Claude Agent SDK, or similar frameworks.
• Experience building an internal AI platform or reusable LLM tooling.

Culture & Benefits

• Opportunity to join as one of the earliest hires and own key technical decisions from the beginning.
• Annual performance bonus, equity, and comprehensive benefits.
• Work on AI systems for regulated financial institutions with a focus on traceable and inspectable outputs.
• Engineering culture centered on curiosity, pragmatism, and technical excellence.