ML Platform Engineer (AI)

Location: 100% remote within the United States

Salary: $100,000–$160,000 annually

Company

hirify.global is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

What you will do

• Design and operate model-serving platforms for LLMs, vision models, and recommendation systems.
• Optimize inference performance through continuous batching, paged attention, speculative decoding, request multiplexing, caching, and prompt deduplication.
• Build multi-tenant routing, rate limiting, quality-of-service policies, autoscaling, and capacity-management systems.
• Tune GPU utilization, memory management, and KV-cache strategies while balancing latency, throughput, cost, and quality.
• Integrate serving platforms with API gateways, identity systems, observability tools, and security controls.
• Develop canary releases, shadow testing, automated rollback, incident response procedures, and reliability improvements for high-availability AI services.

Requirements

• Must be based in the United States.
• Bachelor’s or Master’s degree in Computer Science or a related field.
• 10+ years of experience in distributed systems, infrastructure, or ML platform engineering.
• Strong proficiency in Python and a systems language such as Go, Rust, or C++.
• Experience operating high-throughput, low-latency production services and using LLM or large-model inference frameworks such as vLLM or TensorRT-LLM.
• Experience with GPU architecture, Kubernetes, autoscaling, cloud platforms, observability stacks, performance engineering, capacity planning, and incident response.

Nice to have

• Open-source contributions to model-serving infrastructure.
• Experience with multi-region or globally distributed AI serving.
• Familiarity with model quantization, distillation, compression, and FinOps for AI workloads.
• Experience supporting external-facing AI APIs at scale.

Culture & Benefits

• Full-time direct W-2 employment.
• Opportunity to work on production AI infrastructure and large-scale model serving.
• Collaboration with ML and product teams on model releases and capability rollouts.
• Career growth within an established technology consulting and software development organization.

Hiring process

• Submit a resume for consideration.
• U.S. citizens, Green Card holders, EAD holders, and H-1B transfer candidates may apply; new H-1B visa petitions are not sponsored.