AI Software Engineer (AI Infrastructure)

TL;DR

AI Software Engineer (AI Infrastructure): Building and optimizing next-generation intelligent data infrastructure and storage systems for AI workloads with an accent on GPU clusters, high-performance data pipelines, and distributed systems. Focus on architecting the substrate for AI factories, implementing intelligent caching, and integrating vector stores for massive-scale model training.

Location: Hybrid (3 days in office per week). Must be based in or able to work from Boulder, CO; Pittsburgh, PA; Raleigh, NC; or San Jose, CA

Salary: $130,900 – $194,700

Company

hirify.global is a leader in intelligent data infrastructure, providing unified storage and integrated data services to help organizations unlock the potential of their data from AI to multicloud.

What you will do

• Architect next-generation storage systems and high-performance data pipelines optimized for massive-scale AI model training.
• Design systems for real-time inference and EB-scale data management leveraging AIDE and AFX disaggregated storage architecture.
• Research and implement novel approaches to scalable AI inferencing, semantic data discovery, and data curation.
• Develop intelligent storage capabilities including vector store integration and semantic search.
• Partner with hardware engineers and researchers to deliver storage solutions for autonomous vehicles and pharmaceutical discovery.

Requirements

• 8+ years of software development experience with a focus on systems, infrastructure, or storage technologies.
• Expert-level proficiency in Golang, Python, and C/C++.
• Deep understanding of Linux kernel development, file systems, and distributed systems.
• Experience with AI/ML infrastructure concepts including GPU computing, model serving, and vector databases.
• Must be based in or be able to work from one of the specified US offices (Boulder, Pittsburgh, Raleigh, or San Jose) 3 days per week.

Nice to have

• Experience building or optimizing storage systems specifically for AI/ML workloads.
• Knowledge of high-performance computing (HPC) environments, RDMA, and high-speed interconnects.
• Experience with agile methodologies and rapid prototyping.

Culture & Benefits

• Hybrid work environment balancing in-office collaboration with flexibility.
• Comprehensive benefits package including Health Insurance, Life Insurance, and Retirement Plans.
• Financial incentives including an employee stock purchase plan and restricted stocks (RSUs).
• Paid Time Off and various leave options.