Data Platform Engineer (AI)

Location: 100% remote within the United States

Salary: $100,000–$150,000 annually

Company

Technology consulting and software development organization delivering cloud, AI, data, and enterprise solutions across the United States.

What you will do

• Design, build, and operate reliable inference platforms for large machine learning models in production.
• Develop systems for request routing, dynamic batching, caching, autoscaling, and GPU utilization.
• Build end-to-end observability across diverse model workloads using metrics, tracing, and structured logging.
• Operate high-throughput, low-latency distributed services and balance latency, throughput, cost, and quality.
• Support model serving infrastructure, external-facing AI APIs, and incident response.

Requirements

• Six or more years of experience in distributed systems, infrastructure, or ML platform engineering.
• Bachelor’s or Master’s degree in Computer Science or a related field.
• Strong proficiency in Python and a systems language such as Go, Rust, or C++.
• Hands-on experience with LLM or large-model inference frameworks such as vLLM or TensorRT-LLM.
• Strong understanding of GPU architecture, memory hierarchies, accelerator utilization, performance engineering, and capacity planning.
• Familiarity with Kubernetes, autoscaling, modern cloud platforms, observability, communication, and incident response.

Nice to have

• Open-source contributions to model-serving infrastructure.
• Experience with multi-region or globally distributed AI serving.
• Familiarity with model quantization, distillation, and compression techniques.
• Exposure to FinOps for AI workloads and cost-efficient serving design.
• Experience supporting external-facing AI APIs at scale.

Culture & Benefits

• Full-time direct W-2 employment.
• Career growth opportunities within an established organization.
• Applicants must be eligible to work in the United States; new H-1B visa petitions cannot be sponsored.