AI Engineer (LLM Agents)

Location: United States — Remote

Company

hirify.global builds telehealth support solutions and healthcare infrastructure for virtual care delivery across all 50 states.

What you will do

• Build and operate production LLM-based agents and assistants used by real customers.
• Design agent runtimes and orchestration for tool calls, context management, handoffs, retries, timeouts, failure handling, and sandboxing.
• Create evaluation datasets, test harnesses, regression tests, and AI-graded evaluations to measure quality and catch regressions.
• Integrate multiple model providers, manage upgrades and fallbacks, and improve observability and cost attribution.
• Connect agents to company data through retrieval-augmented generation, context design, and prompt engineering.
• Partner with operations, product, data platform, and clinical stakeholders to design workflows, protect patient data, and determine when agents should escalate to people.

Requirements

• Bachelor’s degree in Computer Science, Engineering, or a related technical field.
• 5–15+ years of software engineering experience and hands-on experience running production LLM systems relied on by real users.
• Strong depth in at least one area: agent runtime, evaluation, retrieval, or observability and cost.
• Strong production engineering fundamentals across testing, debugging, services, APIs, deployment, and on-call operations.
• Experience handling sensitive data with a security-first mindset and comfort working in greenfield environments.
• Must be based in the United States; the role is remote.

Nice to have

• Healthcare, finance, or insurance experience, including PHI or HIPAA.
• Production experience with Google Cloud Platform.
• Experience migrating systems between model versions or providers.
• Classic machine learning experience beyond LLMs or experience building internal engineering platforms.
• For Senior Staff level: experience leading technical direction and growing one pod into multiple teams.

Culture & Benefits

• Relatively flat organizational structure with autonomy to contribute ideas and make decisions.
• Values centered on autonomy, competence, and belonging.
• Medical, dental, and vision plans for salaried positions.
• Flexible Spending Accounts or Health Savings Accounts, flexible PTO, and 401(k) with company match.
• Life insurance, pet insurance, and additional benefits.