обновлено 11 дней назад
Senior Manager - AI Safety and Evaluation Engineering (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior Manager - AI Safety and Evaluation Engineering (AI): Designing and scaling safety, evaluation, monitoring, and observability capabilities for predictive ML and Generative AI systems in banking with an accent on explainability, fairness, reliability, and regulatory compliance. Focus on building standardized evaluation methodologies, adversarial test cases, telemetry pipelines, and automated circuit-breakers across the bank’s AI portfolio.
Location: Abu Dhabi, United Arab Emirates. Flexible and remote working options may be available subject to eligibility and job requirements.
Company
is a UAE banking organization focused on digital evolution, risk awareness, service quality, and customer experience.
What you will do
- Design, implement, and scale technical measures for the reliability, safety, security, and evaluation of predictive ML and Generative AI solutions.
- Define evaluation rubrics, scoring systems, and comprehensive benign and adversarial test cases for conversational AI, RAG systems, agents, and AI-enabled data access.
- Implement explainability techniques and bias-detection metrics for use cases such as lending and fraud.
- Embed evaluation, monitoring, testing, and explainability capabilities into MLOps and LLMOps platforms.
- Design observability telemetry pipelines, Golden Signals, and automated circuit-breakers while maintaining PII and data privacy standards.
- Act as a technical consultant for AI project teams and establish a unified safety stack and methodology across the AI portfolio.
Requirements
- At least 7 years of experience in ML Engineering, Data Science, or AI evaluation, testing, or safety, ideally in the financial sector.
- Bachelor’s degree in Information Technology, Computer Science, Engineering, or a related discipline.
- Expert Python proficiency and deep knowledge of statistical testing, XAI libraries, and LLM evaluation frameworks such as Ragas, Giskard, and Arize.
- Experience designing observability and monitoring systems at scale.
- Experience leading cross-functional initiatives or serving as a technical mentor or consultant.
- Awareness of AI Governance, AI Ethics, and Responsible AI principles.
Culture & Benefits
- Medical insurance, group life insurance, and personal accident insurance.
- Paid leave and leave airfare.
- Preferential rates on loans and finance facilities, plus staff discounts and offers.
- Children’s education assistance for certain job levels.
- Flexible working arrangements, subject to eligibility and job requirements.
- Instructor-led courses, e-learning, on-the-job training, and professional development programs.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →