Backend Infrastructure Engineer (ML)

TL;DR

Backend Infrastructure Engineer (ML): Designing and building secure, scalable core infrastructure and ML training/serving architectures with an accent on reliability, cost efficiency, and low latency. Focus on scaling low-latency voice interfaces, developing high-leverage developer tooling, and optimizing distributed ML systems.

Location: Must be based in San Francisco, Bellevue, or New York

Salary: $175,000 - $280,000

Company

hirify.global is an AI-driven company focused on creating lifelike computers and voice agents that integrate naturally into daily life.

What you will do

• Design and build secure, maintainable, self-serve core infrastructure for engineering teams.
• Architect and evolve scalable, reproducible ML training and serving infrastructure.
• Own and scale the low-latency voice interface and audio processing pipeline.
• Develop high-leverage developer tooling, server infrastructure, and data infrastructure.
• Set technical direction within your domain and raise the engineering bar across the team.

Requirements

• 3+ years of software engineering experience, specifically in infrastructure, platform, or ML systems.
• Significant production experience operating and scaling Kubernetes clusters.
• Proven track record of shipping services at scale and managing operational complexity.
• Strong expertise in reliability engineering, observability, monitoring, and loosely coupled architectures.
• Experience designing and shipping flexible domain models and APIs.
• Must be based in San Francisco, Bellevue, or New York.

Nice to have

• Significant experience with Infrastructure as Code (Terraform, Pulumi, or CloudFormation).
• PyTorch experience, specifically with model optimization for serving.
• Experience with ML serving tools like TorchServe, Seldon, KServe, or Ray Serve.
• Background in data engineering, pipeline design, or complex database schema design.
• Experience with real-time communication systems (low-latency audio/video/streaming).

Culture & Benefits

• 401(k) with a maximum employer match of 3.5%.
• 100% employer-paid health, vision, and dental benefits for employees and dependents.
• Unlimited PTO and sick time.
• Medical FSA with employer matching up to $1,650 per year.
• Competitive stock options to share in the company's success.