Software Engineer (GenAI)

TL;DR

Software Engineer (GenAI): Designing and building advanced LLM-driven workflows for healthcare systems with an accent on agentic capabilities, structured tool use, and seamless integration with retrieval systems. Focus on developing rigorous evaluation frameworks and owning the end-to-end productionization of LLM workflows in high-uptime environments.

Location: Hybrid in San Francisco, CA (3 days/week onsite). Relocation assistance is available for candidates willing to move to San Francisco.

Salary: $255,000–$300,000

Company

hirify.global is a healthcare AI company transforming patient-clinician conversations into structured clinical notes in real-time, focusing on responsible AI deployment in health systems.

What you will do

• Design and build GenAI systems leveraging retrieval, tool use, agentic reasoning, and structured outputs.
• Collaborate with ML and infra engineers to scale and optimize GenAI workflows.
• Write high-quality, modular code that’s graceful under failure, flexible to change, and easy to iterate on.
• Drive architectural decisions for workflows, data flow, caching, and generative outputs.
• Implement rigorous evaluation, building datasets, automated and human-in-the-loop frameworks, and A/B tests.
• Rapidly prototype with new models, capabilities, open-source tools, and prompting techniques.

Requirements

• 3+ years of experience building production-grade systems, with 1–2+ years focused on GenAI or LLM-powered products.
• Deep fluency with LLM APIs, prompting strategies, and orchestration patterns (e.g., LangChain, LlamaIndex).
• Experience with retrieval systems (semantic/lexical retrieval, vector DBs), function calling, tool-use, or agentic workflows.
• Working knowledge of model evaluation, building diverse datasets, and conducting automated/human-in-the-loop evaluations.
• Strong Python fundamentals, including clean code, comprehensive test-cases, and async programming knowledge.
• Must be willing to work from our SF office at least 3x per week.

Culture & Benefits

• Generous Time Off: 14 paid holidays, flexible PTO for salaried employees.
• Comprehensive Health Plans: Medical, Dental, and Vision coverage for all full-time employees and their families, with generous HSA contributions.
• Paid Parental Leave and Family Forming Benefits.
• 401(k) Matching and Personal Device Allowance.
• Pre-tax Benefits: Access to Flexible Spending Accounts (FSA) and Commuter Benefits.
• Lifestyle Wallet: Monthly contributions for fitness, professional development, coworking, and more.
• Mental Health Support and Sabbatical Leave after 5 years.
• Competitive compensation and equity grants for full time employees.