Lead Inference Engineer (AI)

Location: Fully remote within the United States

Salary: $270,000–$330,000 base salary per year

Company

hirify.global has partnered with a rapidly growing AI company building large-scale AI infrastructure.

What you will do

• Set the technical strategy for LLM inference performance.
• Recruit and lead the Inference Optimisation team.
• Optimize latency, throughput, and cost per token across distributed GPU infrastructure.
• Benchmark inference engines, quantisation methods, and parallelism strategies.
• Improve inference routing and load balancing.
• Evaluate new kernels, hardware, and optimization techniques.

Requirements

• 8+ years of experience in performance optimization, HPC, or GPU engineering.
• 5+ years of experience leading engineering teams.
• Production experience with vLLM, SGLang, or similar inference engines at scale.
• Strong knowledge of GPU architecture, distributed inference, and quantisation.
• Experience with GPU profiling tools such as Nsight or PyTorch Profiler.
• Proficiency in Python, Rust, or Go.

Nice to have

• C++, CUDA, or Triton experience.

Culture & Benefits

• Fully remote work within the United States.
• Opportunity to build and lead the inference function.
• Work on high-volume AI infrastructure and advanced GPU technology.
• $270,000–$330,000 annual base salary.