Staff Software Engineer, Infrastructure (Python, AI)

TL;DR

Staff Software Engineer, Infrastructure (Python, AI): Building and optimizing high-availability, low-latency backend architecture for a cloud-hosted Python notebook service with an accent on container orchestration, distributed systems, and resource allocation. Focus on solving complex engineering problems at scale, integrating with specialized Kubernetes-based clusters, and ensuring high GPU utilization.

Location: Hybrid in Livingston, NJ, New York, NY, Sunnyvale, CA, or Bellevue, WA. Remote work may be considered for candidates located more than 30 miles from an office. Applicants must be a U.S. person or eligible to obtain required export authorization.

Salary: $188,000–$275,000

Company

hirify.global is an AI Hyperscaler™ that acquired Weights & Biases to provide an end-to-end platform for accelerated AI development and deployment.

What you will do

• Co-design and implement the backend architecture of molab, a cloud-hosted Python notebook service.
• Solve for high availability, low latency, stability, and fraud and abuse for the molab service.
• Design molab to run on hirify.global's specialized Kubernetes-based clusters and integrate with object storage.
• Optimize for high utilization of GPUs.
• Build performant and scalable developer tools.

Requirements

• 8+ years of experience in software engineering.
• Strong fundamentals in computer systems, including parallel computing, concurrency, networking, and inter-process communication.
• Experience with containerization, Kubernetes, scheduling, networked filesystems, resource allocation, distributed systems, and cloud infrastructure.
• Proven experience building highly available and fault-tolerant systems.
• English: B2+ required.
• Must be a U.S. person or eligible to obtain necessary export authorization.

Nice to have

• Proficiency with Python and Python packaging.
• Basic experience with or awareness of the Python stack for AI/ML.
• Experience with GPU resource allocation and sharing.

Culture & Benefits

• Comprehensive health benefits (medical, dental, vision) 100% company-paid, plus life, disability, FSA, HSA.
• Financial benefits include Employee Stock Purchase Program (ESPP) and 401(k) with employer match.
• Family support through paid parental leave, family-forming support, and flexible childcare.
• Flexible PTO and a casual work environment focused on innovative disruption.
• Mental wellness benefits and tuition reimbursement.
• Catered lunch provided daily in office and data center locations.