Staff ML Systems Engineer (AI)

TL;DR

Staff ML Systems Engineer (AI): Designing and operating the production infrastructure powering AI across the health platform with an accent on Kubernetes platform, CI/CD, and model-serving. Focus on building reliable LLMOps pipelines, ensuring HIPAA compliance, and optimizing inference infrastructure for patient outcomes.

Location: Remote (Must be US-based)

Salary: $210k – $250k + Equity

Company

A leading public health and wellness platform redefining healthcare through personalized, affordable, and accessible digital care.

What you will do

• Own and evolve the containerized deployment platform (EKS) and autoscaling (Karpenter) for AI workloads.
• Build and maintain GitOps-based deployment pipelines using Helm and Kustomize overlays.
• Operate and scale multi-provider LLM AI gateways (Bedrock, Vertex) and platform-level serving patterns.
• Provision and scale the observability stack including Langfuse, Datadog, OpenTelemetry, and ClickHouse.
• Improve the monorepo build system and CI/CD pipelines to increase developer velocity.
• Implement IAM, OIDC, and secrets management to ensure HIPAA compliance and security-by-default.

Requirements

• 8+ years of experience in infrastructure, platform, DevOps, or SRE engineering.
• 3+ years specifically focused on ML/AI systems in production.
• Deep expertise with Kubernetes (EKS), Terraform, and Python for production tooling.
• 2+ years of experience with LLMOps, including inference routing and serving at scale.
• Hands-on experience with observability/tracing stacks (Datadog, OpenTelemetry, Langfuse).
• Must be based in the US to align with the stated compensation range.

Nice to have

• Experience with Databricks (MLflow, Unity Catalog, Spark, Delta).
• Knowledge of monorepo build systems such as Pants or Bazel.
• Contributions to open-source infrastructure, IaC modules, or developer tooling.
• Experience in regulated domains such as healthcare, fintech, or life sciences.

Culture & Benefits

• Competitive salary, equity compensation, and Employee Stock Purchase Program (ESPP).
• Unlimited PTO, company holidays, and quarterly mental health days.
• Comprehensive medical, dental, and vision insurance, including parental leave.
• 401k benefits with employer matching contribution.
• Offsite team retreats.