Senior Software Engineer (AI Frameworks)

TL;DR

Senior Software Engineer (AI Frameworks): Accelerating and optimizing large language model deployment on MAIA AI accelerators and GPUs with an accent on PyTorch, inference systems, and high-performance kernels. Focus on designing tensor computation primitives, optimizing LLM inference stacks, and implementing performance-critical runtime components.

Location: United States, Washington, Redmond

Salary: $119,800 - $234,700 per year

Company

hirify.global is a global leader in software and AI infrastructure, focused on empowering every person and organization on the planet to achieve more.

What you will do

• Architect and implement efficient tensor computation primitives and software abstractions for custom AI accelerators.
• Develop and extend PyTorch features for model onboarding, optimization, and execution on custom hardware.
• Contribute to AI inference stacks such as vLLM and SGLang, focusing on scheduling, KV cache management, and serving pipelines.
• Design, profile, and optimize high-performance kernels for NPUs (MAIA) and GPUs to accelerate LLM workloads.
• Collaborate across disciplines to define requirements and deliver practical solutions to complex technical challenges.

Requirements

• Bachelor's Degree in Computer Science or related technical field.
• 4+ years of technical engineering experience with C, C++, or Python.
• Experience with PyTorch internals, custom operators, hardware backends, or torch.compile/Dynamo optimization.
• Experience with AI inference stacks like vLLM, SGLang, or similar large-scale serving systems.
• Experience with NPU or GPU kernel development (e.g., CUDA, Triton).
• Familiarity with LLM concepts: attention mechanisms, KV caching, quantization, and distributed parallelism (TP, PP, DP).

Culture & Benefits

• Collaborative and inclusive culture driven by a growth mindset.
• Opportunity to shape the software powering the world's most advanced AI infrastructure.
• Competitive base pay range with additional benefits for eligible roles.
• Focus on values of respect, integrity, and accountability.