Principal Data Engineer (LLM/AI Platforms)

TL;DR

Principal Data Engineer (LLM/AI Platforms): Designing, building, and deploying data infrastructure for LLMs, Retrieval-Augmented Generation (RAG), and agentic AI security features at Exabyte scale with an accent on distributed data platforms, agentic workflow enablement, and production-grade MLOps/DataOps. Focus on architecting fault-tolerant, cost-effective pipelines, leading technical mentorship, and turning research prototypes into scalable, monitored services.

Location: USA - Remote

Salary: $195,000 - $290,000 per year (base) + bonuses/equity (U.S. candidates)

Company

hirify.global is a cybersecurity company building an AI-native security platform.

What you will do

• Architect, implement, and optimize LLM-focused data platforms and pipelines for RAG and agentic AI systems at Exabyte scale.
• Drive adoption and deployment of agentic workflows and agent harnessing to deliver autonomous, data-driven security capabilities.
• Design highly scalable, fault-tolerant, and cost-effective data solutions with rapid iteration and high-quality deployments.
• Build production-ready code with strong performance, maintainability, and testing rigor.
• Lead technical best practices for MLOps/DataOps for LLM services, including monitoring, observability, and zero-touch recovery.
• Mentor engineers through workshops and design reviews; collaborate with Data Scientists and Product Managers to ship research into production.

Requirements

• 10+ years of progressive Data Engineering/Platform Engineering experience, including at least 3 years architecting and building AI/ML or Data Science platforms at massive scale.
• Hands-on LLM engineering experience (fine-tuning, prompt engineering, deployment), plus RAG and agentic workflow development.
• Proven experience designing and delivering large-scale distributed systems (e.g., sharding, partitioning, concurrency).
• Strong engineering practices: effective peer code reviews, resilient architecture, and comprehensive testing.
• Prior Principal or Staff-level engineering experience with technical leadership and mentorship.
• Master’s degree or PhD in Computer Science/Data Engineering (or related STEM) or equivalent practical experience.

Culture & Benefits

• Comprehensive physical and mental wellness programs.
• Competitive vacation and holidays, plus paid parental and adoption leaves.
• Professional development opportunities for all employees.
• Employee networks and volunteer opportunities.
• Vibrant office culture with world-class amenities.
• Market-leading compensation and equity awards.

Hiring process

• Interviews focused on technical leadership, system design, and hands-on experience with LLM/RAG/agentic platforms.
• Design review and mentorship/engineering excellence evaluation.
• Final steps include standard background checks.