Senior Machine Learning Engineer: Search Quality (AI)

TL;DR

Senior Machine Learning Engineer: Search Quality (AI): Developing and optimizing LLM-based evaluation systems and real-time reranking for a global ecommerce search platform with an accent on search relevance, LLM fine-tuning, and latency optimization. Focus on building automated quality monitoring pipelines and scaling LLM inference across multi-domain and multi-language environments.

Location: Remote (Global) - choose where you live

Salary: $80k–$120K USD + Stock options

Company

AI-first ecommerce search and discovery platform that helps global brands drive revenue and conversion gains.

What you will do

• Fine-tune LLMs to assess search relevance, understand query intent, and align model judgments with real user behavior.
• Implement real-time reranking, filtering, and signal computation while maintaining strict latency requirements.
• Develop automated quality monitoring pipelines and agent-based systems to generate actionable product data recommendations.
• Optimize and scale LLM inference across 20+ domains and 40+ languages globally.
• Design and execute A/B tests to validate the real-world impact of model improvements.
• Collaborate with cross-functional teams including ranking, product, and data engineering.

Requirements

• 4+ years of experience shipping production ML systems.
• Strong background in search, information retrieval, or recommendation systems.
• Hands-on experience with LLM fine-tuning, evaluation frameworks, and scaling deployments.
• Proficiency in Python, PyTorch, SQL, and data orchestration tools such as Spark and Airflow.
• Excellent English communication skills.
• Experience working within cross-functional team environments.

Culture & Benefits

• Fully remote work culture with a provided work-from-home stipend.
• Unlimited vacation time, with a strong encouragement to take at least 3 weeks per year.
• Annual training and development budget for every employee.
• Apple laptops provided for all new hires.
• Maternity and paternity leave for qualified employees.
• Equity through stock options in addition to base salary.