GenAI Software Engineers

Location: Hybrid; must work from the San Francisco or New York office at least 3 times per week. Relocation assistance is available for candidates willing to move to San Francisco.

Salary: $255,000–$300,000 estimated annual base salary for mid, senior, and staff-level engineers, plus equity.

Company

hirify.global is a healthcare AI company building an enterprise platform that transforms patient-clinician conversations into structured clinical notes with real-time EMR integrations.

What you will do

• Design and build agentic systems using LLMs, retrieval, structured outputs, tool use, and agentic reasoning.
• Scale and optimize workflows by managing latency, context windows, model selection, and intermediate state.
• Make architectural decisions about data flow, generative outputs, caching, and workflow structure.
• Build benchmark datasets and automated and human-in-the-loop evaluation frameworks.
• Design experiments, run A/B tests, investigate failure modes, and incorporate clinician feedback into model improvement.
• Productionize LLM workflows in low-latency, high-uptime environments with monitoring, observability, guardrails, and versioning.

Requirements

• 3+ years of experience building production-grade systems, including 1–2+ years focused on LLM-powered or agentic products.
• Deep familiarity with LLM APIs, prompting strategies, and orchestration patterns such as LangChain, LlamaIndex, or custom pipelines.
• Experience with retrieval systems, vector databases, efficient k-nearest-neighbor search, function calling, tool use, or agentic workflows.
• Knowledge of model evaluation, diverse dataset development, automated and human-in-the-loop evaluation, A/B testing, and collaboration with subject-matter experts.
• Strong Python fundamentals, clean modular code, comprehensive test cases, and familiarity with core language features and standard libraries.
• Ability to work from the San Francisco or New York office at least 3 times per week.

Nice to have

• Experience with asynchronous programming, performance profiling, packaging, and deployment tooling.
• Experience rapidly prototyping with new models, open-source tools, and advanced prompting techniques.

Culture & Benefits

• Fast-paced, high-growth startup environment with an emphasis on ownership, empathy, and measurable impact.
• Flexible work hours, inclusive culture, and ongoing learning opportunities.
• Paid holidays, flexible PTO, paid parental leave, and sabbatical leave after 5 years.
• Medical, dental, vision, HSA, FSA, commuter, and mental health benefits.
• 401(k) matching, personal device allowance, lifestyle wallet, family-forming benefits, and equity grants.