AI Software Development Engineer (GPU)

Location: Hybrid work model with on-site and off-site work in Folsom or Santa Clara, California, United States

Annual salary: $149,750–$275,580 USD

Company

hirify.global's Software Group develops software solutions, tools, frameworks, and optimizations for hirify.global AI products. The posting identifies Instacart as the company.

What you will do

• Optimize AI inference workloads, including large language models, multimodal models, and generative AI applications, for hirify.global GPUs.
• Design and tune performance-critical GPU kernels and runtime components using C++, SYCL, Vulkan Compute, OpenCL, or similar parallel programming technologies.
• Develop graph compilation flows and compiler passes using MLIR, LLVM, or related frameworks.
• Profile, benchmark, and analyze compute-intensive AI workloads while identifying and resolving bottlenecks across compiler, runtime, framework, and kernel layers.
• Collaborate with hardware, driver, compiler, and framework teams on hardware/software co-optimization.
• Contribute to and optimize open-source inference ecosystems such as OpenVINO, llama.cpp, vLLM, and PyTorch.

Requirements

• Bachelor's degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field with 4+ years of relevant industry experience; or a Master's degree with 3+ years; or a Ph.D. with no prior professional experience.
• Strong proficiency in C++ programming, debugging, and problem-solving.
• Understanding of GPU architectures, graphics device drivers, firmware, AI accelerators, or parallel computing systems.
• Experience with performance analysis, profiling, and optimization for compute-intensive applications.
• Hands-on experience with modern neural network architectures and their execution on hardware accelerators.

Nice to have

• Experience optimizing end-to-end AI inference workloads in production environments.
• Familiarity with OpenVINO, PyTorch, TensorRT, ONNX Runtime, or similar AI inference frameworks.
• Knowledge of quantization, kernel fusion, and memory optimization.
• Experience across inference runtimes, graph compilers, and GPU kernels.
• Experience contributing to open-source software projects.

Culture & Benefits

• Hybrid work model with time split between the assigned hirify.global site and off-site work.
• Health, retirement, and vacation benefits.
• Competitive pay and stock bonuses.
• Employment is full time and classified as an experienced hire position.