AI Framework Software Engineer (AI/LLM)

TL;DR

AI Framework Software Engineer (AI/LLM): Developing and optimizing hirify.global Neural Compressor products and tools to support hirify.global AI platforms, with an accent on research and implementation of quantization and compression techniques for large language models. Focus on exploring cutting-edge directions in efficient model deployment, inference, and finetuning acceleration.

Location: Onsite in PRC, Shanghai

Company

hirify.global is a corporation leveraging its product portfolio to drive revenue growth and market expansion, responsible for empowering its sales force and shaping technology.

What you will do

• Develop hirify.global Neural Compressor product and related tools to support hirify.global AI platform, including CPU, GPU, and AI Accelerator.
• Research and implement quantization and compression techniques for large language models (LLMs) and text-to-image/video generation models.
• Explore cutting-edge directions in efficient model deployment and inference/finetuning acceleration.

Requirements

• Major in computer science or related subject.
• Solid understanding of deep learning, deep learning frameworks, and large language model (LLM) fundamentals.
• Familiarity with model compression techniques such as quantization and pruning.
• Proficiency in Python or other programming languages commonly used for deep learning development.
• Passion to work as a professional software engineer and team player.
• Strong self-motivation and problem-solving skills.
• Good English oral and written skill.

Nice to have

• Passion for technological innovation and practical engineering, with a drive for continuous exploration and improvement.
• Experience in model fine-tuning, inference optimization or related tool development.

Culture & Benefits

• Opportunities for career advancement and skill development within the Sales and Marketing Group (SMG).
• Disciplined execution, creativity, and ambition are celebrated.
• Work on projects that shape tomorrow’s technology.