Applied AI Engineer

Location: Remote

Salary: $150k–$175k base salary

Company

hirify.global builds infrastructure for trustworthy, safe, aligned, and emotionally intelligent AI systems for frontier AI labs, enterprises, and life sciences organizations.

What you will do

• Own the production LLM gateway and inference path, including provider routing, logging, cost attribution, rate limiting, failover, and PHI controls.
• Maintain the approved catalog of models, providers, endpoints, and features, documenting retention, BAA coverage, version pinning, and decision records.
• Build the release path for model and prompt changes with versioning, CI evaluation gates, staged rollouts, rollback, and self-service templates.
• Turn validated AI/ML prototypes, evaluation harnesses, and acceptance thresholds into scalable, observable production services.
• Instrument and monitor LLM services for latency, failures, token usage, cost, output quality, and evaluation drift; participate in on-call and incident response.
• Partner with Security and Compliance to produce audit evidence for SOC 2, ISO 27001, HIPAA, and FDA 21 CFR Part 11.

Requirements

• 5+ years of backend software engineering experience, including production multi-tenant SaaS services and APIs.
• Production experience with commercial LLM APIs such as Anthropic, OpenAI, AWS Bedrock, or Azure OpenAI, including prompt management, structured outputs, and tool use.
• Hands-on experience designing LLM output evaluation pipelines and integrating them into CI/CD as release gates.
• Strong Python skills; NodeJS is a plus.
• Experience with AWS, containers such as ECS or similar, and infrastructure as code using Pulumi, Terraform, or CDK.
• Experience with observability tooling such as OpenTelemetry or Datadog, plus version control, feature flags, CI, and issue tracking.
• Working knowledge of application security, including secrets management, access control, and sensitive-data handling.
• Ability to translate between researchers, clinicians, and engineers and communicate through decision records, design documents, and diagrams.

Nice to have

• Experience in regulated healthcare or life sciences domains, including HIPAA, SOC 2, ISO 27001, or FDA 21 CFR Part 11 validated systems.
• Experience building an internal developer platform or paved road used by other teams.
• Experience with LLM-as-judge evaluation, red teaming, or conversational analytics.
• Experience training or fine-tuning models from scratch.

Culture & Benefits

• Remote, full-time engineering role reporting to the CTO.
• Close collaboration with platform engineering, AI/ML, research, Security and Compliance, domain experts, sales, and delivery teams.
• Emphasis on operational excellence, systems thinking, quality, clarity, reliability, reproducibility, and auditability.
• Work includes high-stakes healthcare, safety, wellbeing, and sensitive-data use cases.