3 дня назад
QA Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
QA Engineer (AI) (LegalTech/SaaS): Testing AI-assisted legal technology workflows that retrieve, categorize, store, and deliver court documents across portals and integrations with an accent on exploratory testing, backend validation, security, and AI feature evaluation. Focus on designing risk-based test scenarios, investigating silent failures, validating document classification, and building targeted Playwright or API checks.
Location: United States; fully remote and open to every US time zone, including Hawaii
Company
builds legal technology that retrieves court notices and legal documents, categorizes them with AI, and delivers them to law firm document and case management systems.
What you will do
- Perform risk-based exploratory, functional, regression, and manual testing across the Vue dashboard, admin tools, email notifications, and integrations.
- Validate document retrieval, parsing, categorization, storage, and delivery across court portals, 2FA/OTP logins, and systems such as Clio, Filevine, iManage, and NetDocuments.
- Test backend and platform behavior using API calls, SQL queries, logs, dashboards, Grafana/Loki, and Sentry.
- Evaluate AI document categorization and LLM-facing tools using sample sets, repeated trials, hostile inputs, and accuracy checks.
- Investigate customer and production issues, reproduce defects, and write actionable bug reports.
- Collaborate with engineers and product managers on sprint planning, acceptance criteria, backlog refinement, and retrospectives; create focused automated checks where useful.
Requirements
- 3–7 years of software quality assurance experience with complex web or SaaS applications and strong exploratory and manual testing skills.
- Experience writing or maintaining automated tests with Playwright, Selenium, or API test scripts, including reviewing AI-generated tests.
- Experience testing AI or LLM features, including classification accuracy, hallucinations, prompt injection, repeated trials, and sample-set validation.
- SQL skills for PostgreSQL, plus direct API testing with Postman, curl, or Bruno and knowledge of HTTP, REST, and JSON.
- Experience with authentication, sessions, roles and permissions, OAuth2/SAML, CSRF, XSS, third-party integrations, email-driven workflows, and browser automation.
- Experience with WCAG 2.2 AA accessibility testing; ISTQB or similar certification, legal-domain knowledge, and Lean Startup experience are relevant qualifications.
Nice to have
- Experience with Docker or Kubernetes, including port-forwarding or checking pod logs.
- Experience creating focused Playwright or API automation checks with AI assistance.
Culture & Benefits
- Company-provided AI tools with guidelines for safe use.
- Flexible working hours and a fully remote working model.
- Health, dental, vision, and life insurance options.
- Discretionary time off in addition to scheduled vacations and holidays.
- Employee stock option plan.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →