System Software Engineer (AI)

Location: Hybrid in Montreal, Canada

Salary: 100,000–180,000 CAD per year, plus equity, benefits, and RRSP

Company

hirify.global is a stealth-mode startup developing foundational infrastructure to improve performance, scalability, and resiliency in large-scale AI data center clusters.

What you will do

• Design and implement communication and execution primitives connecting high-level AI frameworks with low-level system software.
• Help shape foundational infrastructure for next-generation AI models.
• Analyze and resolve performance bottlenecks in distributed training and inference workloads.
• Investigate the software-hardware interface and conduct performance benchmarking on multi-node clusters.
• Collaborate across the technology stack on early-stage product development.

Requirements

• Strong proficiency in C++ and Python.
• Deep understanding of systems programming fundamentals, including memory management, concurrency, and operating system internals.
• Proficiency in a Linux development environment.
• Bachelor’s or Master’s degree in Computer Engineering, Computer Science, or a related field.

Nice to have

• GPU programming experience with CUDA and performance optimization for parallel architectures.
• Experience with distributed AI frameworks such as PyTorch, JAX, or DeepSpeed.
• Experience with inference engines such as vLLM, SGLang, Dynamo, or TRT-LLM.
• Hands-on experience with large-scale cluster orchestration and telemetry tools.

Culture & Benefits

• Work alongside experienced builders and operators in an early-stage product environment.
• Collaboration is based on trust, integrity, respect, unity, and shared responsibility.
• Benefits include meaningful equity, employee benefits, and RRSP contributions.
• The company operates across remote and on-site locations in the United States and Canada.