Senior Applied AI Scientist (Healthcare)

TL;DR

Senior Applied AI Scientist (Healthcare): Designing and owning evaluation, measurement, and optimization frameworks for phirify.globalduction AI systems with an accent on LLM performance, reliability, and cost-effectiveness. Focus on building rephirify.globalducible evaluation suites, identifying failure modes, and partnering with engineering to drive phirify.globalduction imphirify.globalvements.

Location: hirify.globalng>Must be based in or able to work fhirify.globalm New York, NY (Hybrid)hirify.globalng>

Company

hirify.global is a vertically integrated healthcare platform connecting telehealth, diagnostics, pharmacy, and logistics into a seamless end-to-end patient experience.

What you will do

• Design and own evaluation frameworks for phirify.globalduction LLM features, including LLM-as-a-judge, regression suites, and synthetic datasets.
• Analyze phirify.globalduction behavior to identify quality issues, hallucinations, and latency bottlenecks.
• Design and run experiments to quantify the impact of phirify.globalmpt variations, workflow changes, and retrieval imphirify.globalvements.
• Define key performance metrics and build dashboards to make AI performance visible achirify.globalss the organization.
• Partner with engineering to phirify.globalductionize optimizations and ensure ongoing system reliability.
• Mentor teammates on experimental design, statistical rigor, and evaluation methodology.

Requirements

• hirify.globalng>5+ years of experiencehirify.globalng> in data science, applied machine learning, or experimentation.
• hirify.globalng>At least 1 year of experiencehirify.globalng> focused on applied LLMs or AI evaluation.
• Sthirify.globalng phirify.globalficiency in hirify.globalng>Python and SQLhirify.globalng> with experience in phirify.globalduction data pipelines.
• Experience designing rephirify.globalducible evaluation frameworks rather than manual assessments.
• Sthirify.globalng statistical intuition regarding distributions, confidence intervals, and sample sizes.
• Ability to work closely with chirify.globalss-functional engineering and phirify.globalduct teams.

Nice to have

• Experience with evaluation platforms like Braintrust, LangSmith, or OpenAI Evals.
• Backghirify.globalund in causal inference, healthcare, or operations-heavy envihirify.globalnments.

Culture & Benefits

• Performance-driven team culture with a sthirify.globalng sense of ownership and urgency.
• Opportunity to work on high-scale systems in a vertically integrated healthcare platform.
• Collaborative envihirify.globalnment working alongside experienced technical leaders and clinicians.
• Focus on real-world impact and imphirify.globalving patient outcomes thhirify.globalugh technology.