6 дней назад
Senior AI Engineer (Fintech)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior AI Engineer (Fintech) (Python/LangChain): Building evaluation and assurance infrastructure for LLM-powered agents, retrieval systems, and product knowledge workflows with an accent on grounded answers, deterministic quality checks, and reusable release gates. Focus on designing evaluation datasets, calibrating LLM judges against human ratings, measuring retrieval quality, and integrating trustworthy AI checks into production systems.
Location: Vietnam, R&D Department
Company
develops software platforms for banking and financial services.
What you will do
- Design and implement a configurable evaluation and assurance framework for data, retrieval, agents, and generated answers.
- Build evaluation datasets from acceptance criteria, maintain separate development and test samples, and freeze golden sets.
- Develop and calibrate LLM judges, analyze failure modes, define measurable metrics, and compare results with human ratings.
- Evaluate retrieval relevance, corpus coverage, freshness, and answer quality through release-blocking quality gates.
- Build agentic workflows, RAG and GraphRAG pipelines, AI services, monitoring, tracing, and evaluation tooling.
- Provide technical leadership, mentor junior engineers, and contribute to AI architecture and strategy.
Requirements
- Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
- 5+ years of professional engineering experience, including at least one LLM-based system taken to production.
- Excellent written and verbal English communication skills.
- Production experience with LangChain, LangGraph, or an equivalent agent framework, including tools, skills, and MCP.
- Strong Python skills, asynchronous programming, RAG architectures, and experience with LangSmith, Langfuse, or Promptfoo.
- Practical knowledge of evaluation methodology, thresholds, regression baselines, dataset splitting, leakage prevention, and CI release gates.
Nice to have
- Experience designing scalable distributed services in Kubernetes environments.
- Java experience, especially integrating AI services with a Java backend.
- DevOps experience with CI/CD, cloud-native logging, monitoring, Docker, Kubernetes, AWS, or Azure.
- Fintech, banking security, and compliance experience.
- Testing or quality engineering experience and production monitoring of AI systems.
Culture & Benefits
- Work with a small, senior Data Enablement team serving data and AI needs across the organisation.
- Contribute to internal AI strategy, engineering standards, and reusable platform capabilities.
- Build systems where access control, correctness, observability, and trustworthy releases are core requirements.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
5 дней назад
GenAI / Agentic AI Developer
100 000 - 150 000$
7 дней назад
Senior AI Developer
2 дня назад
Senior Software Engineer – AI Tools | Data Engineering | Experienced Hire
225 000 - 250 000$
5 дней назад
Senior AI Engineer
179 000 - 241 000$
3 дня назад
AI Engineer (Fintech)
5 дней назад