LLM Platform Engineer (AI)

TL;DR

LLM Platform Engineer (AI): Designing and scaling the core infrastructure for large language model applications with an accent on retrieval systems and evaluation frameworks. Focus on deploying RAG systems, MCP servers, and human-in-the-loop feedback pipelines to ensure AI dependability and performance at scale.

Location: Must be based in the US and live within commuting distance of New York, Seattle, Los Angeles, or San Francisco hubs

Salary: $245,000 – $345,000 per year

Company

hirify.global is the largest live shopping platform in North America and Europe, allowing users to buy, sell, and discover items across hundreds of categories.

What you will do

• Own the infrastructure powering LLMs across critical surfaces including growth, recommendations, trust and safety, and fraud.
• Create robust and scalable LLM evaluation frameworks to measure performance and prevent regression via CI/CD.
• Deploy RAG systems and MCP servers to ground LLM responses in business context while enforcing PII controls.
• Design efficient human-in-the-loop feedback pipelines to inform scalable model evaluation.
• Bridge the gap between research and production to transform experimental ideas into scalable solutions.

Requirements

• 4+ years of professional experience developing machine learning systems and algorithms.
• 3+ years of software engineering experience building production systems for consumer-scale loads.
• 1+ years of professional software development experience in Python.
• Experience with operational, search, and key-value databases such as PostgreSQL, DynamoDB, Elasticsearch, or Redis.
• Familiarity with AWS services (Sagemaker, Lambda, Kinesis, S3, EC2, EKS/ECS) and Apache Kafka or Flink.
• Must live within commuting distance of the New York, Seattle, Los Angeles, or San Francisco hubs.

Culture & Benefits

• Flexible time off policy including company-wide spring and winter breaks.
• Comprehensive health insurance (medical, dental, vision) and 401k with employer match up to 4%.
• Work-from-home support including home office setup and monthly cell phone/internet allowances.
• Care benefits including monthly wellness allowance, annual childcare allowance, and family planning benefits.
• 16 weeks of paid parental leave plus a one-month gradual return to work.
• Monthly budget to dogfood the app as both a buyer and seller.