Staff Software Engineer (AI)

TL;DR

Staff Software Engineer (AI): Building core Python/Rust platforms for request routing, orchestration, and GPU autoscaling with an accent on distributed system fundamentals and low-latency performance. Focus on scaling platform architecture to handle 100x traffic while leveraging AI for system automation and complex multi-tenant compute challenges.

Location: Must be based in or be able to relocate to San Francisco, CA

Salary: $180,000–$250,000

hirify.global

hirify.global is an AI infrastructure company building high-performance compute platforms for developers.

What you will do

• Develop core infrastructure including request routing, scheduling, and GPU autoscaling.
• Design systems for large-scale file storage, queueing, and distributed compute.
• Produce architectural roadmaps to scale platform capacity by 100x current traffic.
• Tune low-level CPU and memory performance in Python and Rust environments.
• Utilize AI to automate complex system operations and maintenance.
• Drive technical decisions and cross-team collaboration for platform evolution.

Requirements

• 5+ years of experience building distributed compute and orchestration platforms.
• Proficiency in Python or Rust.
• Deep understanding of distributed systems fundamentals like consensus, scheduling, and fault tolerance.
• Expertise in computational complexity and memory allocation.
• Proven track record of designing systems that scale under real production load.
• Must be based in or willing to relocate to San Francisco (visa sponsorship provided).

Nice to have

• Experience with AI/ML inference or training infrastructure.
• Expertise in high-performance systems programming such as async runtimes and memory-safe concurrency.
• Background in building multi-tenant compute platforms.
• Understanding of GPU workload scheduling and networking performance characteristics.

Culture & Benefits

• Comprehensive health, dental, and vision insurance tailored for US employees.
• Equity-based compensation package.
• Regular team events and company offsites.
• Opportunity to work on highly challenging engineering problems.
• Focus on growth and professional development.