ML Performance Engineer (AI)

Location: 100% remote within the United States; listed location: Sugar Land, TX

Salary: $100,000–$150,000 annually

Company

hirify.global is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

What you will do

• Profile and optimize end-to-end AI training and inference pipelines for throughput, latency, and cost.
• Identify bottlenecks across data loading, model computation, communication, memory, storage, and scheduling.
• Implement quantization, sparsity, pruning, KV-cache optimization, continuous batching, speculative decoding, and attention optimizations for LLM serving.
• Optimize distributed training with tensor and pipeline parallelism, FSDP, and ZeRO-style sharding.
• Drive compiler and kernel-level improvements using Triton, XLA, TorchInductor, or TVM, and evaluate new hardware and software.
• Build benchmark and regression frameworks, document tuning playbooks, collaborate with ML and platform teams, and mentor engineers.

Requirements

• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.
• Six or more years of experience in performance engineering, ML systems, or HPC.
• Strong proficiency in Python and C++.
• Hands-on experience optimizing deep learning workloads on modern GPUs.
• Deep understanding of distributed training and inference techniques.
• Experience with profiling tools across CPU, GPU, and distributed systems.
• Familiarity with model compression techniques and their accuracy implications.
• Strong understanding of memory hierarchies, communication primitives, and parallelism strategies.
• Excellent measurement, debugging, analytical reasoning, communication, and collaboration skills.

Nice to have

• Production-scale LLM inference optimization experience.
• Contributions to vLLM, TensorRT-LLM, DeepSpeed, or similar projects.
• Custom kernel authoring with Triton or CUTLASS.
• FinOps experience for AI workloads.
• Publications or talks on AI systems performance.

Culture & Benefits

• Full-time direct W2 employment.
• Remote work limited to the United States.
• Established organization with career growth opportunities.
• Cross-functional collaboration with product, design, engineering, operations, and business stakeholders.
• U.S. citizens, Green Card holders, EAD holders, and H-1B transfer candidates are encouraged to apply; new H-1B visa petitions cannot be sponsored.

Hiring process

• Send a resume to Jenny@bvteck.com or contact the listed phone number for immediate consideration.