AI Senior Staff Systems Engineer (AI)

TL;DR

AI Senior Staff Systems Engineer (AI): Leading the development, operations, and support of AI infrastructure with an accent on architecting high-performance GPU clusters and deploying advanced AI models. Focus on optimizing AI tech stacks, managing cloud AI service integrations, and building production-grade Agentic AI workflows.

Location: San Jose, California (US-based role with US-specific benefits).

Salary: $136,500–$253,500 per year.

Company

hirify.global is a leader in electronic design and computational software, hiring innovators to solve complex technological challenges.

What you will do

• Lead the design and implementation of next-generation AI infrastructure for Agentic AI initiatives.
• Manage and optimize on-premise GPU clusters, including hardware troubleshooting and performance tuning.
• Support and secure public cloud AI services on Azure OpenAI and Google Cloud Platform.
• Architect and deploy scalable AI tech stacks using Docker, Kubernetes, and deep learning frameworks.
• Lead the deployment and optimization of LLMs using quantization, distillation, and high-performance serving frameworks.
• Act as the final escalation point for complex technical issues and mentor other engineers.

Requirements

• 10+ years of experience in a senior technical role, with 5+ years in high-performance computing or AI infrastructure.
• Expert-level knowledge of NVIDIA GPU architecture, CUDA, and cuDNN.
• Proven experience managing Azure OpenAI and Google Cloud Platform services.
• Extensive hands-on experience with Docker and container orchestration.
• Deep expertise in Linux system administration, specifically RHEL.
• Proficiency in scripting languages such as Python, Bash, or Perl.

Nice to have

• Experience administering LSF clusters in production environments.
• Familiarity with Slurm job scheduler.
• Experience with AI job profiling and tuning.
• Experience with macOS/AppleSilicon system administration.

Culture & Benefits

• Comprehensive medical, dental, and vision insurance plans.
• 401(k) plan with employer match.
• Employee stock purchase plan.
• Paid vacation and holidays.
• Opportunity to work on cutting-edge AI infrastructure and agentic services.