Systems Performance Engineer (AI)

Location: Santa Clara, CA, United States

Salary: $186,900–$275,000 per annum, plus eligibility for bonus and equity plans.

Company

hirify.global develops semiconductor solutions and AI, cloud, networking, optical, and memory infrastructure platforms.

What you will do

• Drive end-to-end performance optimization across AI serving and training stacks using leading models and customer-relevant configurations.
• Identify bottlenecks across application request flow, compute, memory, communication layers, GPU kernels, network transport, and storage pipelines.
• Develop and execute reproducible benchmark methodologies for customer use cases.
• Profile serving-stack internals, including quantization, scheduling, KV-cache management, and disaggregated prefill/decode.
• Work with NRE/SRE teams and network or fabric architects to improve competitive performance.
• Create benchmark artifacts, visualizations, and performance summaries for customer presentations, executive reviews, and trade shows.

Requirements

• Experience with AI serving frameworks such as vLLM, SGLang, TensorRT-LLM, or similar platforms.
• Strong knowledge of RCCL/NCCL, RDMA, communication-compute overlap, and performance profiling.
• Hands-on experience with GPU profiling tools such as Nsight Systems/Compute, PyTorch Profiler, or ROCm Compute Profiler.
• Experience diagnosing end-to-end bottlenecks across application, framework, runtime, and infrastructure layers.
• Working knowledge of a distributed training framework such as PyTorch DDP/FSDP, DeepSpeed, or Megatron-LM; strong Python and Linux skills.
• Experience with containerized environments, especially Docker; Kubernetes knowledge is useful for benchmark reproducibility.

Nice to have

• Experience benchmarking distributed large-model inference and training systems.
• Familiarity with GPU kernel analysis, system tracing, continuous batching, paged KV-cache attention, and quantization techniques such as GPTQ and SmoothQuant.
• Go experience and exposure to customer proofs of concept, competitive benchmarking, or externally consumed performance reporting.
• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field; a PhD is a plus.

Culture & Benefits

• Work across networking, optics, memory fabrics, compute, and AI infrastructure platforms.
• Benefits support financial well-being, family support, mental and physical health, and recognition.
• Employee stock purchase plan with a two-year lookback, family support programs, mental health resources, and recognition awards.
• Eligibility for bonus plans, a new-hire equity grant, and annual equity refreshers.

Hiring process

• Interviews assess individual experience, thought process, and communication skills in real time.
• AI tools, transcription applications, automated answer generators, and automated note-taking bots are not permitted during interviews.
• The role may require export-control eligibility review for access to U.S.-controlled technology and software.