Infrastructure Engineer (AI)

Location: On-site in San Mateo, California, United States

Company

hirify.global is an early-stage enterprise AI company building a context and data governance layer for AI agents in highly regulated industries.

What you will do

• Design, build, and operate inference and model-serving infrastructure from development through production.
• Scale infrastructure for reliable AI-agent operation under increasing concurrency and production load.
• Identify and resolve infrastructure bottlenecks with ML and platform engineering teams.
• Optimize production systems for latency, throughput, and reliability.

Requirements

• 5+ years of experience building and operating ML inference systems, model-serving platforms, or ML infrastructure in production.
• Experience with inference-serving technologies such as TensorFlow Serving, TorchServe, Triton, KServe, or equivalent custom systems.
• Strong systems engineering fundamentals, including distributed systems, Docker, and Kubernetes.
• Experience optimizing production ML systems for latency, throughput, and reliability under high concurrency.
• Experience with AWS, GCP, or Azure and monitoring, observability, and debugging tools such as Prometheus, Grafana, ELK, or distributed tracing frameworks.
• Proficiency in at least one of Python, Go, Rust, C++, or Java.

Nice to have

• Experience with knowledge graphs, semantic search, or graph databases such as Neo4j or Amazon Neptune.
• Familiarity with agentic AI systems, autonomous agents, or multi-step reasoning pipelines.
• Experience with enterprise data infrastructure, data pipelines, or data integration platforms.

Culture & Benefits

• Hands-on infrastructure ownership across development and production environments.
• Collaboration with ML and platform engineering teams.
• Visa sponsorship is not available.