Senior AI Engineer (LLM)

TL;DR

Senior AI Engineer (LLM): Designing and deploying intelligent, production-grade AI systems that power member experiences and operational efficiency with an accent on LLM systems, distributed cloud infrastructure, and scalable AI applications. Focus on prompt architecture, RAG architectures, multi-agent systems, and production deployment with observability.

Location: Remote, must be based in California

Company

hirify.global is redefining health insurance to make excellent healthcare affordable and accessible for everyone.

What you will do

• Design, architect, and deploy AI-powered systems impacting member experience and operational efficiency.
• Build and optimize LLM-driven applications using advanced prompt engineering, RAG, and agentic workflows.
• Design scalable AI pipelines with modern orchestration frameworks (LangChain, LangSmith, LlamaIndex).
• Architect multi-agent systems for complex multi-step tasks.
• Implement evaluation and monitoring frameworks for AI performance and reliability.
• Own cloud-native AI infrastructure for performance, scalability, cost efficiency, and security.
• Partner with Product and Engineering leadership to identify and execute high-impact AI initiatives.

Requirements

• Bachelor’s or Master’s degree in Computer Science or a related field.
• 5+ years of professional software engineering experience with meaningful ownership of production systems.
• Significant hands-on experience building and deploying AI/ML systems in production.
• Strong proficiency in Python and TypeScript.
• Deep experience with LLM APIs (OpenAI, Anthropic, AWS Bedrock) and orchestration frameworks (LangChain, LangSmith, LlamaIndex).
• Strong understanding of advanced prompt engineering techniques, LLM optimization, RAG systems, vector databases, and semantic search applications.
• Cloud infrastructure expertise (AWS preferred): Lambda, Step Functions, API Gateway, DynamoDB, S3.
• Strong understanding of LLM behavior: tokenization, embeddings, context limits, evaluation, and hallucination mitigation.
• Demonstrated track record of shipping scalable, production-grade AI systems.
• Must be based in California.

Nice to have

• Experience with infrastructure as code (AWS CDK, SAM, Terraform).
• Experience in healthcare, insurance, or regulated environments.
• Experience fine-tuning models or building custom model pipelines.
• Familiarity with observability tools (DataDog, CloudWatch, LangSmith).
• Contributions to open-source AI projects or published technical work.

Culture & Benefits

• Competitive salary, bonus opportunity, and equity package.
• Comprehensive Medical, Dental, and Vision benefits.
• A 401k retirement plan.
• Paid vacation and company holidays.
• Opportunity to make an impact at a rapidly growing mission-driven company transforming healthcare in the U.S.
• Work in a fast-paced startup environment with a bias for action, ownership, and pragmatism.