Principal Software Engineer (Infrastructure)

TL;DR

Principal Software Engineer (Infrastructure): Design and implement backend architecture for a cloud-hosted Python notebook service with an accent on high availability, low latency, fault tolerance, and GPU resource optimization. Focus on building scalable, performant cloud infrastructure and solving complex concurrency and distributed systems challenges.

Location: Hybrid in Livingston, NJ / New York, NY / Sunnyvale, CA / Bellevue, WA, USA

Salary: $206,000–$303,000

Company

hirify.global, part of CoreWeave, provides an end-to-end AI platform combining cloud infrastructure and developer tools to accelerate AI development and deployment.

What you will do

• Design and implement backend architecture for the molab cloud-hosted marimo notebook service.
• Ensure high availability, low latency, and fault tolerance of systems.
• Integrate with CoreWeave's Kubernetes-based clusters and object storage.
• Optimize GPU resource allocation and utilization.
• Develop scalable, performant infrastructure supporting AI-assisted coding and interactive data apps.
• Collaborate with cross-functional teams to solve greenfield engineering challenges.

Requirements

• Must be a U.S. person or eligible to access export controlled information per U.S. Government regulations.
• 8+ years of software engineering experience with strong fundamentals and language agnostic skills.
• Expertise in computer systems including parallel computing, concurrency, networking, and inter-process communication.
• Experience with containerization, Kubernetes, scheduling, distributed systems, and cloud infrastructure.
• Proven ability to build highly available and fault-tolerant systems.
• Strong written and verbal communication skills.

Nice to have

• Proficiency with Python and Python packaging.
• Familiarity with Python AI/ML stack.
• Empathy for AI, ML, data engineering, NLP, or quantitative research practitioners.
• Experience with GPU resource allocation and sharing.

Culture & Benefits

• Comprehensive medical, dental, and vision insurance fully paid by employer.
• Company-paid life insurance and disability coverage.
• Flexible spending and health savings accounts.
• Tuition reimbursement and employee stock purchase program.
• Paid parental leave and family-forming support.
• 401(k) with employer match and flexible PTO.
• Casual work environment with catered lunches and quarterly team gatherings.
• Focus on innovative disruption and supportive workplace culture.

Hiring process

• Onboarding at one of the company hubs within the first month.
• Interviews assessing technical skills and cultural fit.
• Consideration of diversified experiences beyond exact skill matches.