Senior Engineer - ML Operations (AI)

Location: USA - Remote; fully remote from a home location in the United States, with travel of up to 10%.

Annual salary: $180K-$220K, plus eligible bonus/incentive pay.

Company

hirify.global is a science and technology corporation operating across life sciences, diagnostics, and biotechnology through more than 15 businesses.

What you will do

• Own the end-to-end ML and LLM lifecycle, including experiment tracking, registries, versioning, lineage, reproducibility, model serving, autoscaling, GPU efficiency, and inference performance.
• Productionize agentic workflows and automations with orchestration frameworks, containerized and sandboxed execution, secure tool and data integrations, and support for concurrent users and workflows.
• Implement CI/CD, testing, offline and online evaluation, guardrails, blue/green and canary deployments, tracing, alerting, and feedback loops for ML models and agents.
• Improve AI compute and cost efficiency through GPU scheduling, quota and utilization management, provider routing, rate limits, and CUDA image hygiene.
• Build self-service ML and agent tooling, reusable templates, golden paths, and MLOps/LLMOps standards while providing hands-on technical leadership.

Requirements

• Degree in Computer Science, Engineering, or a related technical field, or equivalent practical experience.
• 4+ years of software, ML, or infrastructure engineering experience, including hands-on MLOps/LLMOps and taking ML models or AI agents into production at scale.
• Strong experience with experiment tracking, evaluation, observability and monitoring, model registries, versioning, lineage, and reproducibility, including tools such as MLflow, Weights & Biases, or Langfuse.
• Strong experience with Docker and Kubernetes, including scaling GPU and inference workloads.
• Experience with a major cloud platform, Azure preferred, and AI services such as Azure ML or Azure AI Foundry, using IaC and CI/CD for ML.
• Proficiency in Python and familiarity with Bash for automation, tooling, and pipeline development.
• Must work remotely from the United States and be able to travel up to 10%.

Nice to have

• Production experience with agentic systems, including multi-agent orchestration, tool calling, RAG, sandboxing, permission setting, and prompt-injection defenses.
• Experience operating ML or AI systems in regulated environments such as GxP, SOX, or HIPAA, including traceability, audit evidence, and AI governance controls.
• Experience with high-performance LLM serving and AI gateway platforms such as vLLM, TGI, Triton, or LiteLLM, or serverless GPU compute platforms.

Culture & Benefits

• Remote work arrangement from home for eligible roles.
• Paid time off, medical, dental, and vision insurance, and 401(k) benefits for eligible employees.
• Continuous-improvement culture with opportunities to work across hirify.global operating companies.
• Employment includes comprehensive benefits and potential bonus or incentive pay.