Principal System Software Engineer, AI Inference Execution

Location: Hybrid, onsite at the Santa Clara, CA headquarters 3 days per week

Salary: $195,000–$285,000 annual base compensation, plus equity and bonus opportunities

Company

hirify.global develops software and hardware innovations for generative AI and AI computing.

What you will do

• Productize the software stack for the AI compute engine.
• Develop, enhance, and maintain next-generation AI deployment software.
• Build and scale deployment infrastructure within tight development timelines.
• Optimize hardware-software co-design trade-offs across the full-stack toolchain.
• Collaborate with system software, machine learning, compiler, and hardware experts.

Requirements

• 12+ years of industry software development experience with a bachelor's degree, or 6+ years with a master's degree in a relevant field.
• Strong knowledge of system software, data structures, computer architecture, and machine learning fundamentals.
• Proficiency in C, C++, and Python in a Linux environment.
• Experience designing and implementing distributed, high-performance software.
• Strong ownership, leadership, collaboration, and self-motivation.

Nice to have

• Experience with inference servers and model-serving frameworks such as TensorRT-LLM, vLLM, or SGLang.
• Experience with PyTorch, TensorFlow, ONNX Runtime, or TensorRT.
• Experience with NCCL, OpenMPI, Kubernetes, Ray, or other MLOps tools.
• Experience deploying LLM, VLM, or NLP workloads on distributed systems.
• Startup, small-team, cloud-provider, or AI-compute company experience.

Culture & Benefits

• Collaborative and inclusive environment focused on respect, humility, and direct communication.
• Medical, dental, and vision coverage.
• 401(k) and an employee rewards package supporting overall wellbeing.
• Equity and performance-based bonus opportunities.