ML Platform Engineer (AI)

Location: 100% remote within the United States; the posting also lists North Brunswick, NJ.

Salary: $100,000–$160,000 annually.

Company

hirify.global is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

What you will do

• Design and operate model-serving platforms for LLMs, vision models, and recommendation systems.
• Optimize inference with continuous batching, paged attention, speculative decoding, request multiplexing, caching, prompt deduplication, and response reuse.
• Build multi-tenant routing, rate limiting, quality-of-service policies, autoscaling, and capacity management.
• Tune GPU utilization, memory management, and KV-cache strategies while balancing latency, throughput, cost, and quality.
• Integrate serving systems with API gateways, identity systems, observability platforms, and security controls.
• Develop canary, shadow-testing, rollback, incident-response, documentation, and reliability practices while collaborating with ML and product teams on model releases.

Requirements

• Bachelor’s or Master’s degree in Computer Science or a related field.
• 10 or more years of experience in distributed systems, infrastructure, or ML platform engineering.
• Strong proficiency in Python and a systems language such as Go, Rust, or C++.
• Deep experience operating high-throughput, low-latency services in production.
• Hands-on experience with LLM or large-model inference frameworks such as vLLM or TensorRT-LLM.
• Strong understanding of GPU architecture, memory hierarchies, and accelerator utilization.
• Familiarity with Kubernetes, autoscaling, and modern cloud platforms.
• Experience with observability stacks including metrics, tracing, and structured logging.
• Solid grounding in performance engineering and capacity planning, plus strong communication and incident-response skills.

Nice to have

• Open-source contributions to model-serving infrastructure.
• Experience with multi-region or globally distributed AI serving.
• Familiarity with model quantization, distillation, and compression techniques.
• Exposure to FinOps for AI workloads and cost-efficient serving design.
• Experience supporting external-facing AI APIs at scale.

Culture & Benefits

• Full-time direct W2 employment.
• 100% remote work within the United States.
• Career growth opportunities within an established technology organization.
• Equal employment opportunity and a workplace free from harassment and discrimination.
• U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply; new H-1B visa petitions cannot be sponsored.