aidata sciencetypescriptllmmachine learningrustreactpostgresqlevaluation frameworks
Вакансия из Hirify Global, списка международных tech-компаний Для мэтча и отклика нужен Plus
Пожаловаться
Зарплата и рынок
Средняя
$180к-250к/год
$160к$200кмедиана$220к
По похожим ролям (47) ~ $200к/год
На СНГ рынке: $4.2к/мес ($3.6к - $5.3к)
87
Хорошая вакансия
развернуть
Чётко описанная роль в прикладном ИИ для финансовой сферы сочетает хорошую зарплату с ответственностью за оценку качества, безопасность и улучшение моделей. Основной компромисс - широкий круг задач на стыке ИИ и торговых процессов.
Кликните для подробной информации
Широкая зона ответственностиСовременный стекХороший уровень оплатыИИ в финтехеПонятные задачи
Оценка от Hirify AI
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Подключить Plus
Описание вакансии
Текст:
Hirify AI/Оригинал
TL;DR
Senior Growth Data Scientist (AI) (LLM evaluation and trading systems): Building evaluation frameworks, benchmarks, quality gates, and monitoring for an AI copilot embedded in a cloud-based trading platform with an accent on correctness, safety, latency, regression detection, and model improvement. Focus on designing adversarial market scenarios, improving tool-use reliability, instrumenting AI systems, and ensuring safe execution workflows for sophisticated investors.
Location: Remote
Base salary: $180,000–$250,000 per year, excluding bonuses and equity.
Company
hirify.global is a financial services firm modernizing brokerage infrastructure through a cloud-native clearing, custody, and trading platform.
What you will do
Own the reliability and quality standards for an AI copilot embedded in a trading platform for sophisticated investors.
Design evaluation systems measuring correctness, safety, latency, and regression risk across market analysis, portfolio and risk reasoning, and trading workflows.
Build and maintain golden datasets, scenario suites, adversarial cases, and market- and regime-based test corpora.
Create automated quality gates, regression workflows, monitoring, alerting, incident response, root-cause analysis, and fix-forward processes for AI systems.
Partner with engineering and product teams to define safe tool and action contracts, including previews, confirmations, auditability, and predictable assistant behavior.
Lead model improvement cycles through data collection, labeling, error taxonomies, prompt and tooling changes, fine-tuning, or preference optimization.
Requirements
At least eight years of experience shipping production software and strong proficiency in a programming language.
Strong knowledge of computer science fundamentals, testing methodology, and systems design.
Experience building evaluation frameworks, test harnesses, and benchmark suites for complex systems such as LLMs, agents, search, retrieval, ranking, or recommenders.
Experience with dataset curation, labeling and quality assurance, offline experimentation, and deploying measurable model improvements.
Ability to define metrics, build measurement pipelines, and use data to guide engineering and product decisions.
Comfort debugging model and tooling failures, instrumenting services, and collaborating on frontend and product patterns that improve safety and trust.
Nice to have
Experience with fine-tuning, preference optimization, distillation, or prompt and compiler-style techniques for tool-use reliability.
Experience creating domain-specific benchmarks and adversarial suites for high-stakes applications.
Deep knowledge of trading across asset classes, margin types, execution, and related concepts.
Experience with Rust, performance-sensitive services, incident response, or SLOs for ML and AI systems.
Culture & Benefits
Competitive compensation with company equity and 401(k) matching.
Gender-neutral parental leave and medical, dental, and vision insurance.
Collaboration-focused culture with an emphasis on diverse ideas, cultures, and experiences.
In-office benefits include lunch stipends, stocked kitchens, and happy hours.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →