Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Data Analyst (Search) (Search, Python, SQL): Building metrics, datasets, and data pipelines to improve core search and answer systems with an accent on search quality, LLM-as-a-judge labeling, and production-grade analysis. Focus on diagnosing search pipeline issues, improving snippet quality and page selection algorithms, and designing A/B experiments and evaluation datasets.
Location: Hybrid in Belgrade, Serbia; Berlin, Germany; or London, United Kingdom
Company
Perplexity develops search and answer technologies.
What you will do
- Find and diagnose quality issues in the search pipeline.
- Design metrics from scratch to track and measure search quality.
- Build datasets for model training, including LLM-as-a-judge labeling pipelines.
- Improve search snippet quality and page selection algorithms for indexing.
- Design and analyze A/B experiments to validate improvements.
Requirements
- 4+ years of experience as a data analyst or in a related role.
- Strong coding skills, including production-grade coding at a mid-level backend engineer standard.
- Proficiency with SQL and Python.
- Hands-on experience in at least one of the following: designing metrics from scratch, building LLM-as-a-judge labeling pipelines, training production ML models with measurable improvements, or designing evaluations with known ground truth.
Nice to have
- Experience working on search-related products.
- Knowledge of statistics and A/B experiment design.
- Experience with Apache Spark or Databricks.
Culture & Benefits
- Hybrid work arrangement.
- Full-time employment.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →