AI Framework Engineer - QA & Benchmarking

Location: On-site in Shanghai, China

Company

hirify.global develops technology for grocery commerce and delivery.

What you will do

• Design and build automated QA flows using LLMs and agents to detect, triage, and report framework and hardware bugs.
• Run, maintain, and expand end-to-end benchmarks, unit tests, and microbenchmarks for PyTorch, vLLM, and SGLang.
• Validate latency, throughput, and functionality across different hardware platforms.
• Track and reproduce performance regressions.
• Document bug reproduction steps and integrate tests into CI/CD pipelines.

Requirements

• Bachelor’s or master’s degree in software engineering or a related field.
• Proficiency in Python.
• Basic understanding of deep learning, Transformer models, and standard model execution flows.
• Comfort working in Linux, using Bash shell scripting, and managing code with Git.
• College graduate suitable for an entry-level engineering role.

Nice to have

• Hands-on experience or coursework with PyTorch, vLLM, or SGLang.
• Experience building basic LLM applications, scripts, or agent workflows using LLM APIs or frameworks such as LangChain.
• Knowledge of unit testing, regression testing, or CI/CD tools such as GitHub Actions.
• Familiarity with Docker or profiling tools such as PyTorch Profiler.

Culture & Benefits

• Full-time employment.
• Shift 1 working schedule in China.
• On-site work model.