Research Engineer, Data Infrastructure (AI)

TL;DR

Research Engineer, Data Infrastructure (AI): Building and operating the next generation of data infrastructure for massive compute fleets and storage systems with an accent on high performance and scalability. Focus on architecting the migration from legacy orchestrators, implementing production-grade pipelines, and optimizing workload placement across multi-cluster environments.

Location: Hybrid in Palo Alto, USA

Company

hirify.global is a pioneering company democratizing AI through high-performance, open-source models and products.

What you will do

• Build and scale massive distributed compute and storage systems.
• Architect and maintain multi-cluster orchestration layers to optimize workload placement across diverse regions.
• Design the transition to modern columnar storage formats to handle exabyte-scale datasets.
• Contribute to an internal training platform utilizing Kubernetes and SLURM environments.
• Implement systems for data metadata and lineage to manage pipeline complexity.
• Manage cloud-native deployments using modern workflows to ensure platform scalability.

Requirements

• 4+ years of experience in Data Infrastructure, MLOps, or Infrastructure Engineering.
• Proficiency in Python and experience solving data lake challenges with columnar storage standards.
• Strong experience with Kubernetes-native tooling and debugging large-scale distributed systems.
• Ability to build and operate reliable, secure systems from the ground up.
• Comfort with ambiguity in a rapid-growth AI environment.
• Must be based in or able to work in Palo Alto (Hybrid)

Culture & Benefits

• Competitive salary and equity.
• Comprehensive healthcare coverage (Medical, Dental, and Vision) for employees and families.
• 401K pension plan with 6% matching.
• 18 days of PTO.
• Transportation reimbursement for office parking or public transport.
• Gym membership and monthly meal stipends.
• Visa sponsorship availability.