Software Engineer (AI/ML)

TL;DR

Software Engineer (AI/ML): Develop and improve model-serving features on a GPU platform focusing on latency, reliability, and cost. Focus on implementing production features, performance experiments, and operational practices in AI inference systems.

Location: Hybrid in Sunnyvale, CA or Bellevue, WA with remote considered for candidates located more than 30 miles from an office

Salary: $92,000–$135,000

Company

hirify.global is a publicly traded AI-focused cloud platform company delivering superior infrastructure performance and technical expertise to accelerate AI innovation.

What you will do

• Implement features and fixes in Python, Go, and C++ for model-serving services like Triton and vLLM.
• Write tests, code comments, design docs, and participate in code reviews.
• Add metrics, dashboards, and assist with alarms and runbooks.
• Follow on-call runbooks and participate in incident response rotations.
• Contribute to performance experiments such as request batching and caching.

Requirements

• Must be a U.S. person or eligible to access export controlled information per U.S. Government regulations.
• BS/MS in CS, EE, or related field or equivalent experience.
• Experience with Python or Go; C++ and Linux fundamentals; Git and CI basics.
• Exposure to containers and Kubernetes.
• Curiosity about GPU inference concepts like micro-batching and KV cache.
• Location: Must be based in or near Sunnyvale, CA or Bellevue, WA; remote possible if >30 miles from office.

Nice to have

• Internship or project deploying microservices or ML inference demos.
• Coursework or research with PyTorch or TensorFlow; CUDA projects.
• Familiarity with Grafana, Prometheus, or OpenTelemetry.

Culture & Benefits

• Comprehensive medical, dental, vision insurance fully paid by employer.
• Company-paid life insurance and disability coverage.
• Flexible spending and health savings accounts.
• Tuition reimbursement and employee stock purchase program.
• 401(k) with employer match and flexible PTO.
• Casual work environment with catered lunch and quarterly team gatherings.