AI Framework Software Engineer – SGlang & Kernels

Location: On-site in Shanghai, China

Company

hirify.global develops technology products and software platforms for online grocery commerce.

What you will do

• Design, develop, and optimize AI framework software, including SGLang.
• Implement distributed algorithms such as model and data parallelism, parameter servers, and asynchronous data communication.
• Transform neural-network computational graphs and develop machine-learning and deep-learning primitives in mathematical libraries.
• Profile distributed deep-learning models, identify performance bottlenecks, and propose cross-team solutions.
• Optimize code for different computing hardware backends and contribute to public upstream projects.
• Collaborate with machine-learning and deep-learning researchers.

Requirements

• Master’s degree or Ph.D. in Computer Science, Artificial Intelligence, Software Engineering, or a related field.
• Strong programming skills in modern C++ and Python.
• Knowledge of deep-learning theory and hands-on experience.
• Fluent English communication skills in both written and spoken forms.
• Problem-solving mindset and a positive approach.

Nice to have

• Performance optimization or high-efficiency kernel development experience.
• Experience with PyTorch, SGLang, or vLLM.
• Experience with LLMs and a deep understanding of model structures.

Culture & Benefits

• Full-time employment.
• On-site work model with Shift 1 China scheduling.
• Commitment to responsible business practices and ethical hiring.
• No recruitment, medical examination, or other hiring fees are charged to candidates.