Staff Software Engineer, Anywhere Cloud - AI Systems & Runtimes

Location: San Jose, California, United States; hybrid work arrangement

Salary: $184,000–$230,000 annual base salary

Company

hirify.global develops enterprise data and AI infrastructure, helping organizations run workloads across public clouds, private data centers, and the edge.

What you will do

• Lead the architecture and delivery of a cloud-native AI platform for hybrid-cloud environments.
• Design scalable Go and Node.js services that expose AI capabilities for enterprise applications.
• Deploy and operate inference servers such as vLLM and Triton with KServe, KubeRay, or Knative.
• Build internal tooling, SDKs, and AI gateways for integrating foundation models into product features.
• Architect RAG pipelines and prompt-management services connected to vector databases and enterprise data sources.
• Optimize secure, multi-tenant AI workloads and GPU scheduling within Kubernetes.

Requirements

• 6+ years of software engineering experience, including 2+ years focused on AI/ML systems, or equivalent graduate-level experience.
• Bachelor’s degree or equivalent experience.
• Expert Python skills and strong proficiency in Go, Rust, or C++.
• Deep knowledge of LLM deployment, inference runtimes, quantization, Docker, and Kubernetes.
• Experience with LangChain or LlamaIndex and complex AI workflows.
• This role is not eligible for immigration sponsorship.

Nice to have

• Experience with PEFT, LoRA, or QLoRA fine-tuning.
• CUDA programming or GPU profiling with Nsight Systems.
• Open-source contributions to AI projects such as Hugging Face Transformers or vLLM.

Culture & Benefits

• Flexible work-from-home policy within the hybrid role structure.
• Generous paid time off and company-wide unplugged days.
• Mental and physical wellness programs.
• Phone and internet reimbursement.
• Career development opportunities, comprehensive benefits, paid volunteer time, and employee resource groups.