20 дней назад
AI Senior QC
Вакансия из Hirify Global, списка международных tech-компанийДля мэтча и отклика нужен Plus
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
AI Senior QC (AI/LLM Testing): Ensuring quality for a Canvas-integrated AI student tutor and learning coach with an accent on acceptance planning, agent orchestration, safety testing, and pedagogical validation. Focus on designing end-to-end test strategies, verifying prompt and grounding behavior, leading UAT, and coordinating defect triage across client and Europe-based delivery teams.
Location: Chile; remote/office work options. Availability is required during the US–Europe daily overlap window.
Company
is delivering a Canvas-integrated, context-aware AI student tutor and learning coach for an education company.
What you will do
- Create the Acceptance Testing Plan, including acceptance criteria, test data, evidence requirements, severity definitions, retesting, and sign-off procedures.
- Design and execute functional, integration, regression, load, performance, accessibility, safety, and pedagogical-quality testing.
- Test AI agent orchestration, prompt governance, persona-adaptive behavior, content validation, grounding and citation pipelines, and resistance to prompt injection.
- Run safety scenario testing for distress-handling cases and measure detection accuracy and false-positive and false-negative rates.
- Lead UAT with Product, subject-matter, IT, Security/Compliance, and pilot stakeholders, managing defect triage and retesting.
- Verify client-reported bugs, prepare actionable defect reports, and coordinate handoff to the Europe-based delivery team.
Requirements
- Experience leading QA/QC for complex, multi-workstream software programs and creating test strategies and acceptance plans from scratch.
- Experience testing AI, LLM, or conversational-agent systems, including prompt behavior, RAG and grounding validation, output-quality rubrics, and safety guardrails.
- Strong documentation skills for test plans, traceability matrices, defect reports, and readiness packages.
- Strong client-facing communication skills and experience conducting bug-verification sessions.
- Availability during the US–Europe daily overlap window is required.
Nice to have
- Experience with LMS integration testing, including Canvas/LTI, SSO, and roster synchronization.
Culture & Benefits
- Collaboration with AI/ML engineering, application engineering, product, and data engineering specialists.
- Direct interaction with client Product, SME, IT, Security/Compliance, and pilot stakeholders.
- Remote/office work options in Chile.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →