2 месяца назад
UX Data Scientist (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
UX Data Scientist (AI): Designing, measuring, and delivering agentic experiences for complex enterprise workflows with an accent on statistical rigor, experimentation, and LLM behavior evaluation. Focus on building offline and online evals, architecting Scout graphs, analyzing real production behavior, and connecting product decisions to customer and commercial outcomes.
Location: New Delhi, India; hybrid workplace
Company
develops software for critical infrastructure companies to plan, deploy, and manage complex projects at scale.
What you will do
- Design, measure, and deliver agentic user experiences with Product Design and Engineering in a scrum team.
- Define quality standards for agent behavior and convert them into metrics, datasets, and evaluation systems.
- Design and analyze A/B tests, holdouts, and shadow runs with appropriate sizing and rigorous interpretation.
- Build offline and online evaluations for LLM correctness, grounding, safety, tone, and latency.
- Architect Scout graphs and sophisticated AI interactions across complex enterprise workflows.
- Work directly with customers through pilots, betas, usage analysis, and workflow discovery.
Requirements
- Senior-level data science experience combining statistical rigor with hands-on building and production delivery.
- Strong expertise in measurement, experimentation, evaluation, statistics, and machine learning.
- Experience analyzing messy production behavior and distinguishing signal from noise and root cause from symptom.
- Ability to reason about LLM behavior, agent context architecture, decision paths, and communication patterns.
- Ability to collaborate with product management, design, engineering, and customers while owning decisions for an experience area.
Nice to have
- Experience with complex enterprise workflows and customers with specialized or sensitive needs.
- Experience contributing to shared evaluation infrastructure and mentoring others through high-quality reviews.
Culture & Benefits
- Embedded collaboration within a scrum team alongside Engineering and Design.
- Hands-on ownership from instrumentation and evaluation through production delivery.
- Opportunities to mentor colleagues and raise standards for experimentation, evaluation, and agent design.
- Regular customer interaction and exposure to competitive, market, and industry analysis.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →