Staff Software Engineer (Infrastructure)

TL;DR

Staff Software Engineer (Infrastructure): Building and optimizing the backend architecture for the molab cloud-hosted notebook service with an accent on high availability, low latency, and fault-tolerant systems. Focus on designing infrastructure to run on specialized Kubernetes clusters, integrating with object storage, and maximizing GPU utilization for AI-assisted coding workflows.

Location: Must be based in the US (Remote or hybrid in Livingston, NJ; New York, NY; San Francisco, CA; Sunnyvale, CA; or Bellevue, WA).

Salary: $188,000–$275,000.

Company

hirify.global is a specialized cloud provider built for AI, delivering high-performance infrastructure to scale AI labs, startups, and global enterprises.

What you will do

• Co-design and implement the backend architecture for the molab notebook service.
• Optimize systems for high availability and low latency, including rapid kernel spin-up/down.
• Design infrastructure to run on specialized Kubernetes-based clusters.
• Integrate with hirify.global object storage and optimize GPU resource allocation.
• Implement robust solutions for system stability, fraud, and abuse prevention.

Requirements

• 8+ years of experience in software engineering.
• Must be a U.S. person (citizen, permanent resident, or asylee) to comply with U.S. export regulations.
• Expertise in computer systems, including parallel computing, concurrency, and networking.
• Experience with containerization, Kubernetes, and distributed systems.
• Proven track record of building highly available, fault-tolerant systems.
• Strong written and verbal communication skills.

Nice to have

• Proficiency with Python and Python packaging.
• Experience with the Python stack for AI/ML.
• Experience with GPU resource allocation and sharing.
• Empathy for practitioners in AI, ML, and data engineering.

Culture & Benefits

• Comprehensive medical, dental, and vision insurance (100% paid).
• 401(k) with generous employer match.
• Flexible PTO and casual work environment.
• Support for family-forming, mental wellness, and childcare.
• Tuition reimbursement and employee stock purchase program.