Senior Software Engineer (AI Platform)

TL;DR

Senior Software Engineer (AI Platform): Building a scalable AI platform and LLM gateway for HCM solutions with an accent on RAG pipelines, agentic runtime infrastructure, and AI observability. Focus on designing model routing, implementing multi-agent coordination patterns, and creating developer-friendly SDKs to enable platform-wide AI adoption.

Location: USA (Headquarters in Charlotte, NC)

Company

hirify.global is a leading provider of human capital management (HCM) solutions, trusted by more than 200,000 employers and used by 9 million U.S. employees.

What you will do

• Design and build a scalable LLM gateway featuring model routing, prompt management, cost attribution, and caching.
• Develop and operate RAG pipelines, embedding services, and vector search infrastructure for platform-wide use.
• Implement agentic runtime infrastructure, including orchestration, state management, and human-in-the-loop patterns.
• Create developer-friendly SDKs in Python, .NET, and TypeScript to simplify platform adoption for product teams.
• Establish comprehensive AI observability, governance controls, and incident detection capabilities.
• Build automated evaluation pipelines to continuously monitor production quality and model performance.

Requirements

• 5+ years of professional software engineering experience with Python as the primary language.
• 2+ years of experience building production LLM-powered systems (inference, RAG, agentic patterns, or AI infrastructure).
• Working proficiency in C#/.NET for integration with existing platform services.
• Hands-on experience with agentic frameworks such as Semantic Kernel, LangGraph, or LangChain.
• Experience with Azure AI Foundry and Azure OpenAI for model deployment and API integration.
• Must be based in the USA.

Nice to have

• Experience with TypeScript and building developer SDKs or tooling.
• Hands-on experience with AI evaluation frameworks (LLM-as-judge, automated regression testing).
• Knowledge of AI governance practices, including access control and security safeguards.
• Familiarity with Azure Container Apps and infrastructure-as-code (Terraform).
• Awareness of AI regulatory frameworks such as NIST AI RMF or ISO/IEC 42001.

Culture & Benefits

• Work at a company voted as one of the top places to work in the USA 2023.
• High-impact role owning both program execution and technical direction for a large engineering group.
• Opportunity to build cutting-edge AI infrastructure used by millions of workers.
• Collaborative environment with a focus on establishing "paved road" patterns for AI development.