Software Engineer, Compute Infrastructure (AI)

TL;DR

Software Engineer, Compute Infrastructure (AI): Designing and operating the core compute and runtime platform for AI search, assistant, and agentic workloads with an accent on Kubernetes-based systems and multi-cloud infrastructure. Focus on optimizing latency, resource utilization, and scalability for high-throughput AI services across GCP, AWS, and Azure.

Location: Hybrid (4 days a week in Mountain View, CA)

Salary: $140,000 - $220,000 annually

Company

hirify.global is a Work AI platform that provides enterprise search, AI assistants, and agentic capabilities to help organizations manage and act on their knowledge securely.

What you will do

• Design and own backend/platform services for runtime infrastructure focusing on reliability and performance for AI workloads.
• Develop Kubernetes-based runtime primitives and orchestration patterns across a multi-cloud foundation (GCP, AWS, Azure).
• Collaborate with engineering teams to create "golden paths" for deployment, configuration, and runtime operations.
• Optimize latency, resource utilization, and costs for multitenant runtime environments and experimental AI workloads.
• Implement infrastructure-as-code patterns, observability, and guardrails (SLOs, dashboards, alerts) for production services.
• Lead incident response and participate in on-call rotations for critical platform services.

Requirements

• Strong distributed systems fundamentals and experience operating high-throughput, low-latency services in production.
• Experience in backend/platform engineering focused on the intersection of application behavior, infrastructure, and cost.
• Ability to own systems end-to-end, from design and implementation to deployment and ongoing operations.
• Location: Must be based in or able to work hybrid (4 days/week) in Mountain View, CA.
• Pragmatic approach to balancing ideal architecture with the execution speed of a fast-moving startup.

Nice to have

• Experience working in multi-cloud, multi-tenant environments.
• Passion for defining best practices for running AI workloads efficiently at scale.

Culture & Benefits

• Comprehensive medical, vision, and dental coverage.
• 401k plan and a generous time-off policy.
• Home office improvement stipend, plus annual education and wellness stipends.
• Vibrant company culture with regular events and daily healthy lunches.

Hiring process

• The process includes a brief AI-focused exercise or discussion to evaluate how you design and use AI to drive impact in your role.