AI Framework Software Engineer (AI)

TL;DR

AI Framework Software Engineer (AI/C++/Python): Designing and optimizing AI software and frameworks like SGLang with an accent on distributed algorithms, model/data parallel frameworks, and computational graph representation. Focus on optimizing code for hardware backends and profiling distributed deep learning models to resolve performance bottlenecks.

Location: On-site in Shanghai, PRC

Company

hirify.global is a global leader in semiconductor design and AI software optimization, focusing on driving revenue growth and market expansion through strategic technological initiatives.

What you will do

• Design, develop, and optimize AI software and frameworks, contributing to public upstream projects like SGLang.
• Implement distributed algorithms, including model/data parallel frameworks, parameter servers, and asynchronous data communication.
• Transform computational graph representations of neural network models.
• Develop machine learning and deep learning primitives in mathematical libraries.
• Profile distributed deep learning models to identify performance bottlenecks and propose cross-component solutions.
• Optimize code for various computing hardware backends.

Requirements

• Master's degree or Ph.D. in Computer Science, Artificial hirify.globalligence, Software Engineering, or related fields.
• Strong programming skills in modern C++ and Python.
• Foundational knowledge of Deep Learning theory with hands-on experience.
• Fluent English communication skills (both written and spoken).
• On-site presence required in Shanghai, China.

Nice to have

• Experience in performance optimization or high-efficiency kernel development.
• Practical experience with PyTorch, SGLang, or vLLM.
• Deep understanding of Large Language Model (LLM) structures.

Culture & Benefits

• Ample opportunities for career advancement and professional skill development.
• Culture that celebrates disciplined execution, creativity, and ambition.
• Strict adherence to ethical hiring practices and Responsible Business Alliance (RBA) compliance.