AI Infrastructure Engineer (LLM)

Location: On-site in San Francisco, CA or Sunnyvale, CA

Compensation: $250,000–$300,000 + Bonus + Restricted Stock Units

Company

hirify.global is a vertically integrated AI infrastructure company building the future of energy-efficient, high-performance AI compute.

What you will do

• Design and optimize serving architectures for LLMs, including prefill and decode disaggregation.
• Profile and tune inference stacks from frameworks like vLLM and SGLang down to the CUDA kernel level.
• Partner with customer engineering teams to tailor deployments to specific traffic patterns and latency targets.
• Take workloads from early proof of concept to fully monitored, high-performance production services.
• Experiment with optimization methods to improve throughput, latency, and cost-efficiency.

Requirements

• Bachelor's, Master's, or Ph.D. in Computer Science, Engineering, Mathematics, or a related field.
• Hands-on experience shipping production code in Python or C++.
• Familiarity with LLM serving frameworks such as vLLM or SGLang.
• Strong understanding of GPU architecture and performance profiling.
• Experience with AI/ML pipelines and deploying models in production.
• Strong communication skills for explaining technical concepts to customers.

Nice to have

• Experience with CUDA or comparable low-level technologies.
• Strong command of software engineering fundamentals.
• Experience with Docker and Kubernetes.
• Prior work in customer-facing AI/ML roles.

Culture & Benefits

• Competitive compensation including equity and Restricted Stock Units.
• Comprehensive health, dental, and vision insurance with HSA contributions.
• 401(k) retirement plan with up to 4% company match.
• Paid parental leave, disability insurance, and life insurance.
• Professional development and tuition reimbursement programs.
• Daily meals allowance and commuter benefits.