Principal AI Systems Performance Engineer (AI)

Location: San Jose, California, United States

Company

hirify.global develops a full-stack generative AI platform combining its SN40L chip, software stack, and open-source foundation models for enterprise and government use.

What you will do

• Bring up and optimize foundation models such as DeepSeek, Llama, and Qwen on the hirify.global platform.
• Profile and improve model performance across compiler, runtime, and hardware layers.
• Collaborate with machine learning, compiler, runtime, and hardware teams on co-designed AI applications.
• Integrate advances in model architecture, quantization, scheduling, and memory optimization.
• Develop scalable end-to-end inference solutions aligned with customer needs.
• Identify bottlenecks and optimize dataflow and scheduling for single-node and distributed systems.

Requirements

• Bachelor’s or higher degree in computer science, electrical engineering, applied mathematics, physics, statistics, or a related field.
• 3+ years of experience in deep learning performance optimization, compiler/runtime/kernel optimization, hardware-software co-design, or systems performance tuning.
• Proficiency in Python or C++, with strong foundations in algorithms, data structures, and numerical computing.
• Experience with PyTorch, TensorFlow, or JAX.
• Demonstrated ability to analyze and optimize real-world machine learning pipelines.

Nice to have

• Experience with LLM or multimodal model training and inference.
• Background in distributed training, continuous batching, and high-throughput inference systems.
• Knowledge of quantization, graph optimization, kernel fusion, model partitioning, memory hierarchy, caching, and scheduling.
• Experience with DeepSpeed, Megatron, vLLM, TensorRT, CUDA, Triton, OpenCL, cuDNN, or cuBLAS.
• Publications or open-source contributions in ML systems or performance optimization.

Culture & Benefits

• Full-time US employment includes base salary, equity, and benefits.
• Medical insurance premiums are covered at 95% for employees and 77% for dependents.
• Health Savings Account with employer contribution, plus dental, vision, disability, life, AD&D, and flexible spending account options.
• Well-being benefits include Headspace, Gympass+, One Medical, counseling, and an Employee Assistance Program.
• Equal Opportunity/Affirmative Action employment practices apply.