Member of Technical Staff - ML Systems & Inference

Location: Bay Area, California; onsite

Salary: $250,000–$350,000 per year

Company

hirify.global is hiring for a well-funded AI infrastructure startup building the orchestration layer for next-generation AI workloads.

What you will do

• Build production-grade machine learning inference systems.
• Optimize scheduling and memory management for AI workloads.
• Improve KV cache efficiency and inference performance.
• Collaborate with compiler, kernel, and distributed systems engineers.
• Contribute to the development of AI infrastructure and its orchestration layer.

Requirements

• Strong software engineering fundamentals.
• Experience with ML inference or model serving.
• Knowledge of distributed systems and performance optimization.
• Programming experience with Python and/or C++.
• Ability to work onsite in the Bay Area, California.

Nice to have

• Experience with vLLM, TensorRT-LLM, CUDA, or similar technologies.

Culture & Benefits

• Opportunity to help define the infrastructure for next-generation AI workloads.
• Collaboration across ML systems, compiler, kernel, and distributed systems disciplines.
• Work within a well-funded AI infrastructure startup.