Senior Software Engineer (AI)

TL;DR

Senior Software Engineer (AI): Building core platform capabilities for AI products with an accent on API design, system design, and operating reliable backend services in production. Focus on solving ambiguous infrastructure problems end-to-end and driving performance and reliability improvements for scalable AI inference.

Location: Must be based in the USA (San Francisco or New York)

Salary: $185,000–$285,000 USD

Company

hirify.global powers mission-critical inference for the world's most dynamic AI companies by uniting applied AI research, flexible infrastructure, and seamless developer tooling.

What you will do

• Own and lead end-to-end projects and product areas, including architecture and implementation.
• Design ergonomic, developer-friendly APIs and abstractions for infrastructure capabilities.
• Build and operate reliable backend services (rate limiting, auth, quotas, usage metering, migrations) with clear SLOs.
• Drive performance and reliability improvements through profiling, tracing, load testing, and capacity planning.
• Mentor teammates through code reviews, design docs, and technical leadership.

Requirements

• 5+ years of experience building and operating backend systems, distributed systems, or large-scale APIs.
• Proven track record owning low-latency, reliable services.
• Strong infrastructure instincts including observability, incident response, SLOs, and capacity management.
• Comfort working across the stack when needed (backend-first, but willing to dive into frontend/CLI).
• Strong written communication, including clear design docs and effective cross-functional collaboration.
• Interest in AI/ML infrastructure and willingness to learn (ML expertise not required).

Nice to have

• Experience with API gateways, service meshes, Kubernetes, or distributed scheduling.
• Experience building developer platforms: SDKs, CLIs, APIs, and self-serve workflows.
• Experience with inference platforms, LLM runtimes, or performance-sensitive systems.
• Familiarity with multi-tenant isolation patterns.
• Frontend experience (React/TypeScript) or strong product UX instincts for developer tools.

Culture & Benefits

• Competitive compensation, including meaningful equity.
• 100% coverage of medical, dental, and vision insurance for employee and dependents.
• Generous PTO policy including company-wide Winter Break (offices closed from Christmas Eve to New Year's Day).
• Paid parental leave.
• Company-facilitated 401(k).
• Exposure to a variety of ML startups, offering unparalleled learning and networking opportunities.