GPU Software Engineer (CUDA)

Location: 100% remote within the United States

Salary: $100,000–$175,000 annually

Company

hirify.global is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States.

What you will do

• Design and implement high-performance CUDA kernels for AI and high-performance computing workloads.
• Profile and optimize GPU code using Nsight Systems, Nsight Compute, and CUDA profilers.
• Tune memory access, occupancy, register usage, shared memory, and other GPU memory hierarchy parameters.
• Develop optimized libraries, custom operators, and fused kernels for PyTorch, JAX, and Triton.
• Optimize multi-GPU and multi-node training with NCCL, RDMA, MPI, and high-performance networking.
• Build benchmarks and regression tests, evaluate new GPU architectures, document tuning decisions, and mentor engineers.

Requirements

• Six or more years of experience in GPU programming and performance engineering.
• Bachelor’s or Master’s degree in Computer Science, Computer Engineering, or a related field.
• Deep expertise in CUDA C/C++, GPU programming models, modern GPU architectures, and memory hierarchies.
• Production experience profiling and optimizing GPU workloads.
• Experience with NCCL, MPI, high-performance interconnects, and custom kernel integration into ML frameworks.
• Strong C++ skills, systems programming practices, linear algebra, numerical methods, communication, and collaboration.

Nice to have

• Experience with Triton, CUTLASS, TensorRT, FasterTransformer, or vLLM internals.
• Exposure to LLVM or MLIR compiler infrastructure.
• Open-source contributions to GPU or ML performance libraries.
• Experience with large-scale distributed training infrastructure.

Culture & Benefits

• Full-time direct W-2 employment.
• Collaboration with product, design, engineering, operations, business, research, and ML teams.
• Opportunities for code review, design review, mentorship, and career growth.
• Equal employment opportunity workplace.