System Software and Validation Engineer (AI)

TL;DR

System Software and Validation Engineer (AI): Evaluating and improving AI performance of key applications on CPUs and GPUs across various AI/ML workloads with an accent on incorporating RAG usages and vector database technologies. Focus on writing high-quality automation frameworks and building Docker containers for consistent workload execution.

Location: Hybrid, based in US, Oregon, Hillsboro

Salary: $111,030–$211,200 USD annually

Company

hirify.global is a global technology corporation shaping the future of technology in AI, analytics, and cloud-to-edge technology.

What you will do

• Evaluate AI performance for leading-edge CPUs and GPUs across various AI domains including inferencing and training using different frameworks.
• Incorporate emerging RAG usages and vector database technologies into AI CPU and CPU+GPU workflows.
• Write high quality automation frameworks and scripts using Python and Linux for repeatability and consistency.
• Build Docker containers to ensure workloads can be run consistently and reliably across environments.

Requirements

• Master's degree in Computer Science or Data Science.
• 2+ years of experience in AI/Machine learning field.
• 2+ years of experience with LMMs such as Pytorch, TensorRT, TensorFlow, vLLM.
• 2+ years Linux environment development experience.
• 2+ years' experience with multithreaded programming and parallel computing concepts (CPU and GPU).
• 1+ year experience with inference/training LLM and computer vision and natural language models.

Nice to have

• System design or prior software experience.
• Deep understanding of high-performance computing architectures (CPUs and GPUs) and optimization techniques.
• Experience with profiling and performance-analysis tools on GPU and CPU for optimizations and system-level debugging.
• Expert knowledge of Pytorch, TensorRT, TensorFlow, vLLM, CUDA, Scikit-Learn, and SGLang.
• Experience with popular GenAI (llama, deepseek) and non-GenAI models.

Culture & Benefits

• Hybrid work model, allowing employees to split time between on-site at an hirify.global site and off-site.
• Competitive total compensation package, including competitive pay, stock bonuses, and benefits (health, retirement, and vacation).
• Opportunity to power major breakthroughs and create enhancements that improve everyday quality of life.
• Join a team responsible for performance benchmarking and analysis to develop, evaluate, and improve AI performance.