Senior AI Engineer (Healthcare)

TL;DR

Senior AI Engineer (GenAI/LLMs): Designing and scaling Generative AI and agentic systems for a specialty healthcare platform with an accent on RAG pipelines, multi-agent workflows, and LLMOps. Focus on architecting production-grade AI solutions, implementing safety guardrails for regulated environments, and optimizing LLM inference on Azure.

Location: Hybrid (at least 3 days/week in New York, NY or Dallas, TX)

Company

hirify.global is a specialty care platform connecting patients with a curated Network of Excellence for surgery, cancer care, and infusions to deliver high-quality care with significant cost savings.

What you will do

• Architect and deliver production LLM capabilities, including advanced RAG pipelines, structured extraction, and multi-document reasoning.
• Lead the implementation of production agentic systems using frameworks such as LangGraph, AutoGen, or CrewAI.
• Define and implement LLM evaluation frameworks, automated quality benchmarks, and hallucination mitigation controls.
• Champion LLMOps practices including prompt versioning, experiment tracking, CI/CD for AI pipelines, and observability.
• Collaborate with product, clinical operations, and data teams to translate strategic priorities into production AI solutions.
• Mentor junior and mid-level engineers through pairing, design reviews, and technical leadership.

Requirements

• Must be based in or be able to work hybrid (3 days/week) in New York, NY or Dallas, TX.
• 5+ years of experience building production AI/ML systems, with 2–3 years specifically in LLM and GenAI applications.
• Strong proficiency in Python and software engineering fundamentals (modular design, testing, version control).
• Deep hands-on experience with LLM APIs (OpenAI, Azure OpenAI, Anthropic) and advanced prompt engineering.
• Proven experience designing and deploying production RAG systems and multi-step agent workflows.
• Experience with Azure cloud platforms and containerized deployment using Docker and Kubernetes.

Nice to have

• Experience implementing safety, grounding, and compliance controls in regulated industries like healthcare.
• Working knowledge of fine-tuning, RLHF, DPO, or parameter-efficient adaptation (LoRA, QLoRA).
• Experience with healthcare data, clinical documentation, or claims workflows.
• Contributions to open-source AI/LLM projects or applied research publications.

Culture & Benefits

• Comprehensive insurance coverage: Medical, Dental, and Vision.
• Financial benefits including a 401k with company match and Life Insurance.
• Paid Time Off and Paid Parental Leave.
• A culture driven by logic, inclusion, grit, and humanity to navigate the complex healthcare landscape.