Staff Software Engineer (Agentic AI)

TL;DR

Staff Software Engineer (Agentic AI): Designing and delivering an enterprise-grade AI and MLOps platform for agentic applications and multi-agent orchestration with an accent on scalable backend services and LLM integration. Focus on building automated evaluation pipelines, stateful memory architectures, and high-performance RAG systems.

Location: Austin, Texas, USA. Must be based in the USA; the role is not eligible for immigration sponsorship or relocation. Flexible WFH policy is available.

Company

hirify.global empowers enterprises to transform complex data into actionable insights through an open-source powered data platform.

What you will do

• Architect and implement scalable platform services and SDKs supporting autonomous agents and multi-agent collaboration.
• Develop automated evaluation pipelines and trajectory tracking to audit agent reasoning and guardrail compliance.
• Design robust stateful memory architectures for short-term context and long-term semantic/episodic memory persistence.
• Implement AI application services enabling scalable Retrieval-Augmented Generation (RAG) and semantic search.
• Establish engineering best practices, coding standards, and mentor junior engineers to ensure technical excellence.
• Collaborate with Product, Design, and Field Engineering to enhance platform agility and developer velocity.

Requirements

• 8+ years of software engineering experience building scalable backend microservices and distributed systems.
• Deep expertise in Python, gRPC, and SQL; proficiency in Go, Java, or C++ is highly valued.
• Extensive experience with Kubernetes and at least one major cloud platform (AWS, GCP, or Azure).
• Proven experience with agentic frameworks (e.g., LangGraph, AutoGen, CrewAI) and evaluation tooling (LangSmith, Langfuse).
• Mastery of LLM orchestration paradigms (ReAct loops, planning/reflection) and RAG architectures using vector databases (e.g., Pinecone, Milvus).
• Not eligible for immigration sponsorship or relocation.

Nice to have

• Experience with ML orchestration and serving software such as KServe or Knative.
• Familiarity with big data technologies including Apache Spark and Hive.
• Full-stack exposure with React, HTML, and CSS.
• Experience building applications alongside data scientists using TensorFlow, PyTorch, or MLflow.

Culture & Benefits

• Flexible WFH policy and generous PTO.
• Support for work-life balance via "Unplugged Days".
• Comprehensive benefits package including mental and physical wellness programs.
• Phone and internet reimbursement program.
• Paid volunteer time and Employee Resource Groups.