Principal GenAI Platform Engineer (AI)

TL;DR

Principal GenAI Platform Engineer (AI): Building the infrastructure that connects AI systems with existing products to enable seamless delivery of AI-generated insights into agent workflows with an accent on model gateways, prompt/versioning stores, vector databases, and LLM evaluation tools. Focus on designing secure access controls, developing observability solutions, and optimizing infrastructure for scalability and cost efficiency in production workloads.

Location: Remote, USA

Salary: $179,000 - $199,000 per year

Company

hirify.global is a healthcare software company developing safe, scalable, and high-impact generative AI solutions for the industry.

What you will do

• Design, build, and maintain the core infrastructure layer for GenAI products, including model gateways and vector databases.
• Implement secure access controls and authentication mechanisms integrated into AI platform components.
• Develop and manage observability, monitoring, and logging solutions for GenAI workloads.
• Collaborate with product and engineering teams to integrate GenAI infrastructure with agent frameworks and downstream applications.
• Optimize infrastructure for scalability, high availability, and cost efficiency for production workloads.

Requirements

• Extensive experience building and maintaining AI platform infrastructure.
• Proven expertise in Kubernetes and container security.
• Demonstrated experience with observability and monitoring frameworks (e.g., OpenTelemetry, MLFlow).
• Experience with AI infrastructure components such as vector databases, prompt stores, and AI IDEs.
• Must be based in the USA.

Nice to have

• Familiarity with vLLM, SGLang, or similar frameworks for hosting LLM inference workloads.
• Experience with CI/CD pipelines and automation for AI model deployment.
• Strong knowledge of authentication and authorization frameworks integrated into AI platforms.

Culture & Benefits

• Comprehensive total rewards package including base salary and bonuses.
• Full-time employment benefits.
• Fully remote work environment within the US.