Senior Software Engineer (AI)

TL;DR

Senior Software Engineer (AI): Building and evolving the API gateway for an open-model inference platform with an accent on authentication, subscription management, and API surface design. Focus on improving system reliability, resolving inference quality issues, and managing gateway infrastructure.

Location: Remote (Must be based in the US or Canada). Preference for Toronto, Canada. Team operates on Eastern Time.

Company

hirify.global is building a serverless open-model inference platform to provide reliable infrastructure for the next generation of AI creators and enterprises.

What you will do

• Develop features and fix bugs to support new models and resolve user issues.
• Improve API reliability by increasing instrumentation and monitoring.
• Manage and right-size the infrastructure supporting the API gateway.
• Respond to availability incidents and triage issues of inference quality.

Requirements

• Must be based in the US or Canada.
• First-hand experience building with LLMs and familiarity with popular open models.
• Proficiency in web technologies including REST, websockets, DNS, and networking.
• Experience with k8s, Node, Fastify, Redis, MongoDB, and Python.
• Ability to debug complex issues across a wide stack and build necessary instrumentation.

Culture & Benefits

• Remote-first work environment.
• Culture driven by a bias to action and a desire to iterate quickly.
• High responsiveness to users, prioritizing bug fixes over new features.
• Data-driven approach where success is proven by usage data.