LLM Platform Engineer (AI)

TL;DR

LLM Platform Engineer (AI): Designing and scaling the core infrastructure for large language model applications with an accent on RAG systems, evaluation frameworks, and human-in-the-loop feedback. Focus on bridging the gap between machine learning research and production-scale systems to ensure dependable and fast AI experiences.

Location: Must be based in the US and live within commuting distance of the New York, Seattle, Los Angeles, or San Francisco hubs

Salary: $200,000 – $345,000

Company

hirify.global is the largest livestream shopping platform in North America and Europe, enabling users to buy and sell across hundreds of categories.

What you will do

• Own the infrastructure powering LLMs across critical business surfaces, including growth, recommendations, trust and safety, and fraud.
• Create robust and scalable LLM evaluation frameworks to measure model performance and prevent regressions via CI/CD.
• Deploy RAG systems and MCP servers to ground LLM responses in business context while enforcing rigorous PII controls.
• Design efficient human-in-the-loop feedback pipelines to inform scalable LLM evaluation.
• Bridge the gap between research and production, transforming experimental ideas into scalable solutions.

Requirements

• 4+ years of professional experience developing machine learning systems and algorithms.
• 3+ years of software engineering experience building production systems for consumer-scale loads.
• 1+ years of professional experience developing software in Python.
• Experience with operational, search, and key-value databases such as PostgreSQL, DynamoDB, Elasticsearch, and Redis.
• Familiarity with AWS (Sagemaker, Lambda, S3, EC2, EKS/ECS), Apache Kafka, and Flink.
• Must be based in the United States.

Culture & Benefits

• Flexible time off policy and company-wide holidays, including spring and winter breaks.
• Comprehensive health insurance options including Medical, Dental, and Vision.
• Home office setup allowance and monthly stipends for cell phone and internet.
• 401k retirement offering for Traditional and Roth accounts in the US with up to 4% employer match.
• 16 weeks of paid parental leave.
• Monthly allowance to dogfood the app to maintain a deep understanding of the product.