LLM Platform Engineer (AI)

TL;DR

LLM Platform Engineer (AI): Designing and scaling core infrastructure for large language model applications with an accent on RAG systems, MCP servers, and evaluation frameworks. Focus on bridging the gap between AI research and production to build dependable, fast, and scalable AI experiences.

Location: Must live within commuting distance of hubs in New York, Seattle, Los Angeles, or San Francisco

Salary: $245,000 – $345,000 per year

Company

hirify.global is the largest livestream shopping platform in North America and Europe, enabling users to buy and sell items across hundreds of categories.

What you will do

• Own the infrastructure powering LLMs across critical surfaces including growth, recommendations, trust and safety, and fraud.
• Create robust and scalable LLM evaluation frameworks to measure performance and prevent regression via CI/CD.
• Deploy RAG systems and MCP servers to ground LLM responses in business context while enforcing PII controls.
• Design efficient human-in-the-loop feedback pipelines to inform scalable model evaluation.
• Bridge the gap between research and production, transforming experimental ideas into scalable solutions.

Requirements

• 4+ years of professional experience developing machine learning systems and algorithms.
• 3+ years of software engineering experience building production systems for consumer-scale loads.
• 1+ years of professional experience developing software in Python.
• Experience with operational databases such as PostgreSQL, DynamoDB, Elasticsearch, and Redis.
• Familiarity with AWS (Sagemaker, Lambda, S3, EKS/ECS) and Apache Kafka or Flink.
• Must be based in the US and live within commuting distance of New York, Seattle, Los Angeles, or San Francisco hubs.

Culture & Benefits

• Flexible Time off Policy including company-wide spring and winter breaks.
• Comprehensive health insurance options (Medical, Dental, Vision).
• Work-from-home support including office setup and monthly cell phone/internet allowances.
• 401k offering with employer match up to 4% of base salary.
• Annual allowances for wellness and childcare, plus lifetime family planning benefits.
• 16 weeks of paid parental leave with a gradual return-to-work period.