Senior Software Engineer (AI Platform)

TL;DR

Senior Software Engineer (AI Platform): Designing and building a scalable AI infrastructure and LLM gateway with an accent on RAG pipelines, agentic runtimes, and multi-agent coordination. Focus on creating developer-friendly SDKs, implementing AI observability, and establishing governance controls for platform-wide adoption.

Location: USA (Headquarters in Charlotte, NC)

Company

hirify.global is a leading provider of human capital management (HCM) solutions that combines modern technology with expert services for HR, payroll, and benefits leaders.

What you will do

• Design and build a scalable LLM gateway with model routing, prompt management, cost attribution, and caching.
• Develop and operate RAG pipelines, embedding services, and vector search infrastructure.
• Build agentic runtime infrastructure, including orchestration, state management, and human-in-the-loop patterns.
• Create developer-friendly SDKs in Python, .NET, and TypeScript to simplify platform adoption.
• Establish comprehensive AI observability, including usage, latency, and distributed tracing.
• Implement AI governance controls, security protections, and incident detection capabilities.

Requirements

• 5+ years of professional software engineering experience with Python as the primary language.
• 2+ years of experience building production LLM-powered systems (inference, RAG, agentic patterns).
• Working proficiency in C#/.NET for platform interop.
• Hands-on experience with agentic frameworks such as Semantic Kernel, LangGraph, or LangChain.
• Production experience with RAG architecture: chunking strategies, embedding models, and vector search.
• Experience with Azure AI Foundry and Azure OpenAI for model deployment and API integration.

Nice to have

• Experience with TypeScript and building developer SDKs or tooling.
• Hands-on experience with AI evaluation frameworks (LLM-as-judge).
• Knowledge of AI governance practices and regulatory frameworks (NIST AI RMF, ISO/IEC 42001).
• Familiarity with Azure Container Apps and Terraform.

Culture & Benefits

• Voted as one of the top places to work in the USA 2023.
• Comprehensive total rewards offerings for employees.
• Professional environment described as a progressive and open-minded meritocracy.
• Opportunity to own both program execution and technical direction, leading multiple domain teams.