Staff Backend AI Platform Engineer (AI)

TL;DR

Staff Backend AI Platform Engineer (AI): Leading the development of core backend services for an Agentic AI Platform with an accent on reasoning-driven agents, multi-agent orchestration, and outcome-based workflows. Focus on building high-performance APIs, optimizing LLM orchestration, and implementing RAG pipelines for scalable AI deployment.

Location: Hybrid (San Mateo, CA) - Onsite expectations 3x/week (Tues-Thurs)

Salary: $225,000 - $278,000

Company

hirify.global builds uncomplicated service software that delivers exceptional employee and customer experiences through a people-first approach to AI.

What you will do

• Lead implementation of agent runtime orchestration services, focusing on reasoning, planning, and tool invocation.
• Design and develop robust APIs and SDKs that enable internal and external teams to build agent workflows.
• Build and optimize stateful dialog management and memory services for context-aware agents.
• Execute the transition to cloud-native, event-driven backend services using microservices and Kubernetes.
• Implement RAG pipelines and maintain integrations with vector databases such as Pinecone, Weaviate, or FAISS.
• Set engineering standards for automated testing and implement OpenTelemetry for full system visibility.

Requirements

• 6+ years of backend engineering experience and 1-2+ years of hands-on experience in AI/ML platform development.
• Expert proficiency in Java and Python.
• Hands-on experience with LangChain, LangGraph, or LangSmith.
• Deep understanding of event-driven architectures, microservices, and Kubernetes.
• Solid experience with AWS, Terraform, PostgreSQL, and Vector databases.
• Must be based in or able to work from San Mateo, CA to meet hybrid onsite requirements.

Nice to have

• Experience with AI-driven planning systems or dialog state tracking.
• Background in enterprise security including RBAC, SSO, and OAuth2.
• Experience working in high-growth SaaS or startup environments.
• Active contributions to open-source backend or AI frameworks.

Culture & Benefits

• Comprehensive dental, medical, vision, disability, and life insurance.
• Equity, ESPP, and flexible PTO.
• Flexible spending, commuter benefits, and wellness benefits.
• Adoption and parental leave benefits.
• Inclusive environment committed to diversity and equal opportunity.