Senior Software Engineer, Infrastructure (AI)

TL;DR

Senior Software Engineer (Infrastructure/AI): Designs, builds, and operates production infrastructure for high-scale, low-latency AI systems with an accent on reliability, performance, and developer ergonomics. Focus on architecting solutions, optimizing service latencies, and evolving CI/CD and GitOps practices for multi-cloud deployments.

Location: On-site in New York City. This is an in-office company.

Salary: $250,000–$330,000 + Offers Equity

Company

hirify.global is a leading conversational AI platform that empowers brands to deliver concierge customer experiences, backed by world-class investors.

What you will do

• Design and implement critical infrastructure services with strong SLOs, runbooks, and actionable telemetry.
• Partner with research and product teams to architect solutions, evaluate performance, and scale new features.
• Tune service latencies by optimizing networking paths, caching, and CPU/memory/I/O.
• Evolve CI/CD, golden paths, and self-service tooling to improve developer velocity and safety.
• Lead infrastructure-as-code (Terraform) and GitOps practices, reducing drift.
• Participate in on-call and drive down toil through automation and issue elimination.

Requirements

• 5+ years building and operating production infrastructure at scale.
• Depth in at least one area across Core, Data, AI-ML, Platform, or Voice infrastructure.
• Proven track record meeting high availability and low latency targets.
• Excellent observability (OpenTelemetry, Prometheus/Grafana, Datadog) and incident response (PagerDuty) experience.
• Clear written communication and the ability to turn ambiguous requirements into simple, reliable designs.

Nice to have

• Experience as an early backend/platform/infrastructure engineer at another company.
• Strong Kubernetes experience (GKE/EKS/AKS) and across multiple cloud providers (GCP, AWS, Azure).
• Experience with customer-managed deployments.

Culture & Benefits

• Medical, dental, and vision benefits.
• Take what you need vacation policy.
• Daily lunches, dinners, and snacks in the office.
• Company values: Just get it done, Invent what customers want, Winner’s mindset, and The Polymath Principle.