Software Engineer, Platform (AI)

TL;DR

Software Engineer, Platform (AI): Building foundational primitives and scalable infrastructure to accelerate product development and enable LLM-first products with an accent on reliability, scalability, and developer experience. Focus on designing distributed systems, optimizing CI/CD pipelines, and implementing multi-cloud networking to support global users.

Location: Hybrid (Must be based in or near San Francisco, New York City, or Seattle). Office attendance is required at least 25% of the time.

Salary: $300,000 - $320,000 USD

Company

hirify.global is a public benefit corporation focused on creating reliable, interpretable, and steerable AI systems.

What you will do

• Architect and optimize critical development infrastructure, including dev environments, observability, and CI/CD pipelines.
• Build and maintain core service infrastructure, including service mesh and shared libraries.
• Develop cloud-agnostic tooling and multi-region deployments for multi-cloud operations.
• Create scalable identity and authentication solutions including OAuth, RBAC, and SSO.
• Maintain and evolve the Model Context Protocol (MCP) and associated Python and TypeScript SDKs.
• Build training systems for task-specific adaptation of LLMs, focusing on cost and latency profiles.

Requirements

• 5+ years of experience building backend product or platform systems, distributed systems, or developer tools.
• Proficiency in Python, Go, Rust, or similar systems languages.
• Strong fundamentals in service-oriented architectures, networking, and systems design.
• Experience with Kubernetes and major cloud providers (AWS, GCP, or Azure).
• Must be based in or near NY, NJ, SEA, SF, or the Bay Area.
• Bachelor's degree or equivalent combination of education and experience.

Nice to have

• Experience building external developer platforms or infrastructure-as-a-service (IaaS).
• Background in authentication/identity systems or service mesh.
• Familiarity with ML infrastructure or model serving systems.
• Experience in early-stage or fast-growing companies building foundational systems from scratch.

Culture & Benefits

• Hybrid work model with flexible working hours.
• Competitive compensation with optional equity donation matching.
• Generous vacation and parental leave.
• Collaborative "big science" research environment emphasizing communication and impact.
• Visa sponsorship available for eligible candidates.