Software Engineer (MLOps)

TL;DR

Software Engineer (MLOps): Building and scaling the production runtime for an AI-native healthcare revenue operating system with an accent on model deployment, inference endpoints, and batch/streaming workflows. Focus on implementing progressive delivery pipelines, ensuring system reliability via observability, and hardening the platform with Kubernetes and Terraform.

Location: Hybrid in New York City (SoHo office), requiring at least 3 days in-office

Salary: $140,000 – $300,000

Company

hirify.global (part of R1 and R37 Lab) is developing an AI-native Healthcare Revenue Operating System to automate medical coding, billing, and financial workflows on a national scale.

What you will do

• Own the production runtime for the ML stack, managing the deployment and scaling of models across inference endpoints.
• Build progressive delivery pipelines featuring automated rollouts and rollbacks to ensure stable releases.
• Implement end-to-end observability including metrics, logs, traces, and telemetry for drift and regression.
• Harden the infrastructure using Terraform, Kubernetes, and CI/CD to ensure reproducible and auditable ML releases.
• Manage model registries and stage gates, designing scheduled or event-driven retraining workflows.

Requirements

• At least 5 years of software engineering experience with minimum 2 years specifically in MLOps.
• Experience deploying and operating GPU-based models in production via APIs and batch/streaming inference.
• Strong proficiency with Docker, Kubernetes, Infrastructure as Code (Terraform), and CI/CD for model artifacts.
• Experience building system reliability tools, including actionable alerting, runbooks, and incident response.
• Expertise in managing model registries, RBAC, secrets management, and encryption.
• Must be based in or be able to work from the New York City office (minimum 3 days per week).

Nice to have

• Experience working in highly regulated environments, such as healthcare or finance.

Culture & Benefits

• Top-of-market compensation including salary and equity.
• Comprehensive health benefits and 401(k) matching.
• Flexible PTO.
• Hybrid work environment in a mission-driven team.

Hiring process

• Introductory call focusing on background and mission alignment.
• Technical deep-dives covering pseudo-coding and system design.
• In-person culture interview in NYC.
• Reference checks and offer.