Senior AI Infrastructure Engineer (LLM)

TL;DR

Senior AI Infrastructure Engineer (LLM/AI Platforms): Designing and deploying cutting-edge AI infrastructure to power next-generation security products with an accent on LLM training pipelines and scalable inference systems. Focus on optimizing GPU utilization, architecting RAG data platforms, and implementing robust MLOps practices.

Location: Must be based in the USA

Salary: $140,000 - $215,000

Company

Global leader in cybersecurity providing an AI-native platform to protect organizations and stop breaches at a massive scale.

What you will do

• Provision and configure large GPU clusters for LLM training, finetuning, and inference workloads.
• Develop and optimize model-serving infrastructure using frameworks like vLLM and Triton Inference Server.
• Lead model lifecycle management, including versioning, checkpointing, and reproducibility across deployments.
• Architect and maintain data platforms for Retrieval-Augmented Generation (RAG) and AI Agentic Systems.
• Define and enforce MLOps/DataOps best practices, including monitoring and zero-touch recovery mechanisms.
• Collaborate with Data Scientists and Product Managers to transform research prototypes into production-grade services.

Requirements

• 6+ years of experience in Infrastructure/Data Engineering, with at least 2 years focused on LLM-based systems.
• Hands-on experience in cluster provisioning, optimizing training workloads, and maintaining inference pipelines.
• Expert proficiency in Python and distributed training frameworks (PyTorch, Ray, Megatron, or JAX).
• Deep knowledge of Kubernetes, Docker, and Infrastructure as Code (Terraform, Ansible).
• Bachelor’s degree in Computer Science or a related STEM field; Master’s degree preferred.
• Must be a U.S. candidate.

Nice to have

• Prior experience in the cybersecurity, intelligence, or high-compliance industries.
• Experience with agentic workflow frameworks such as LangChain or LlamaIndex.
• Experience with distributed data processing frameworks like Spark, Dask, or Flink.

Culture & Benefits

• Market leader in compensation and equity awards.
• Comprehensive physical and mental wellness programs.
• Competitive vacation, holidays, and paid parental/adoption leaves.
• Professional development opportunities for all employees regardless of level.
• Vibrant office culture with world-class amenities.