Software Engineer Accelerators (AI)

TL;DR

Software Engineer Accelerators (AI): Develop and optimize low-level software kernels and distributed system performance for large-scale AI training and inference on novel accelerator hardware. Focus on prototyping system software, performance modeling, and scaling strategies to enhance AI workloads on emerging compute platforms.

Location: San Francisco, United States (onsite)

Salary: $310,000–$380,000 + equity

Company

hirify.global is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity by pushing AI capabilities and deploying them safely.

What you will do

• Prototype and enable AI software stack on new accelerator platforms.
• Optimize performance of large-scale AI models including LLMs and recommender systems.
• Develop kernels, sharding mechanisms, and system scaling strategies for emerging hardware.
• Collaborate on model-level and system-level performance optimizations.
• Perform system-level performance modeling and debug bottlenecks.
• Work with hardware teams to evaluate and adapt software to new architectures.

Requirements

• Location: Must be able to work onsite in San Francisco, United States.
• 3+ years experience in AI infrastructure, kernels, or hardware-software co-design.
• Experience with accelerator platforms at data center scale (e.g., TPUs, custom silicon).
• Strong knowledge of kernels, sharding, runtime systems, and distributed scaling.
• Familiarity with optimizing LLMs, CNNs, or recommender models for hardware efficiency.
• Experience in performance modeling and software stack adaptation for novel architectures.