Analyst Of GPT Models (AI)

TL;DR

Analyst Of GPT Models (AI): Collecting data for training and evaluating the quality of models through the construction of automated data processing systems with an accent on offline (quality assessment on pre-collected baskets) and online approach (conducting A / B experiments). Focus on the development of a system of metrics for Alice and agent systems end-to-end, ensuring data quality for agent tasks and working on reflection, memory and personalization of Alice.

Location: Работа в российских офисах Яндекса

Компания

hirify.global is a technology company that builds intelligent products and services powered by machine learning.

Что делать

• Develop a common system of offline metrics for Alice, create an evaluation pipeline, and define quality criteria and data for creating a wow product.
• Provide additional product quality metrics and data for individual agent tasks.
• Work on reflection, memory and personalization.

Требования

• Knowledge of probability theory and mathematical statistics.
• Deep knowledge of SQL, Python/Pandas.
• Ability to write analytical production code and create instructions, able to see the product or project as a whole.
• Experience with both Data Science and product analytics.
• Skills in analyzing and building effective data processing processes.
• Interest in the development of AI assistants.
• Initiative and readiness for independent search for solutions.

Хорошо, если есть

• Experience with NLP, crowdsourcing markups and ML.

Культура и преимущества

• Extended medical insurance starts working from the first month in hirify.global, including dentistry, annual checkups, emergency assistance abroad, treatment of critical diseases, including oncology, and accident insurance.
• Psychotherapy in the office or online services.
• Laser vision correction after a year of work.
• Pregnancy and childbirth management - after two years.
• Internal educational platform, mentoring and programs for beginner and experienced leaders.
• Participation in specialized conferences is paid for - both as a speaker and as a participant.