Member Of Technical Staff (AI)

TL;DR

Member of Technical Staff (AI): Designing and scaling high-performance inference serving systems and distributed reinforcement learning infrastructure with an accent on throughput optimization, KV-cache management, and latency reduction. Focus on building reliable rollout pipelines, automating fault detection, and eliminating performance bottlenecks across GPU and networking layers.

Location: Must be based in or be able to relocate to San Francisco

Salary: $225,000 - $550,000

Company

hirify.global is an AI startup focused on the safe deployment of AGI with a highly focused, hands-on engineering team.

What you will do

• Design and scale high-performance inference serving systems to optimize throughput and latency for long-context workloads.
• Build and maintain distributed infrastructure for Reinforcement Learning (RL) and post-training processes.
• Optimize KV-cache management, batching strategies, and GPU scheduling.
• Improve the reliability of rollout, evaluation, and reward pipelines.
• Automate fault detection and recovery for serving and RL systems.
• Profile and eliminate performance bottlenecks across GPU, networking, and storage layers.

Requirements

• Strong software engineering and distributed systems fundamentals.
• Experience building or operating large-scale inference or training systems.
• Deep understanding of GPU execution constraints and memory trade-offs.
• Proven ability to debug performance issues in production ML systems.
• Strong analytical skills for system-level trade-offs between latency, throughput, and cost.
• Track record of owning critical production infrastructure.

Culture & Benefits

• Competitive annual salary and significant equity package.
• Comprehensive 401(k) plan with 6% employer matching.
• Generous health, dental, and vision insurance for employees and dependents.
• Unlimited paid time off policy.
• Visa sponsorship and relocation stipend available for San Francisco.
• Fast-paced, high-focus environment emphasizing integrity and teamwork.