Senior Software Engineer (AI)

TL;DR

Senior Software Engineer (AI Hardware): Designing and optimizing kernels for a hardware platform purpose-built for LLM training and inference with an accent on tight integration of silicon, systems, and software. Focus on implementing parallelism, SIMD optimization, and low-level systems tuning to deliver higher performance than GPU-based solutions.

Location: Hybrid in Mountain View, CA (3 days onsite, Tuesday–Thursday)

Compensation: $120,000–$350,000

Company

A venture-backed company building next-generation AI compute infrastructure optimized specifically for transformer training and inference at massive scale.

What you will do

• Design and optimize kernels that interface directly with custom AI hardware.
• Build high-performance software powering training and inference for large-scale ML workloads.
• Collaborate with ML research and hardware engineering teams to bridge software and silicon.
• Improve system performance through parallelism, SIMD optimization, and low-level tuning.
• Contribute to the software stack architecture for next-generation AI compute systems.
• Write production-quality systems code in performance-critical environments.

Requirements

• Proficiency in at least one of: Rust, C, C++, Zig, or Assembly.
• Experience optimizing software for specialized hardware (GPU, TPU, ASIC, or similar).
• Strong knowledge of parallel computing techniques (SIMD, CUDA, or distributed workloads).
• Background in high-performance computing or performance-critical systems programming.
• Bachelor’s degree in Computer Science or equivalent experience.
• Must be able to work hybrid in Mountain View, CA.

Culture & Benefits

• Opportunity to work on cutting-edge AI hardware backed by over $630M in funding.
• Collaborative environment bridging the gap between ML research and silicon engineering.
• Work on infrastructure designed to enable GPT-4 class models to run more efficiently.