3 дня назад
Senior QA Automation Engineer (AI)
Мэтч & Сопровод
Для мэтча с этой вакансией нужен Plus
Описание вакансии
Текст:
TL;DR
Senior QA Automation Engineer (AI): Building and scaling Playwright-based UI and API test automation integrated with CI/CD for daily releases in a B2B SaaS supply-chain platform, with an accent on automated coverage, quality instrumentation, and AI-assisted testing. Focus on designing evaluation harnesses for non-deterministic LLM outputs, measuring defects and model quality, and mentoring a small QA team while remaining hands-on.
Location: Austin, Texas, United States. Applicants must be authorized to work for any employer in the U.S. and eligible to obtain and maintain a U.S. Secret or Top Secret security clearance.
Company
provides an AI-native B2B SaaS platform that connects U.S.-based manufacturers with suppliers for commercial and federal defense supply chains.
What you will do
- Drive the transition from manual testing to a comprehensive Playwright automation suite.
- Build, maintain, and scale automated UI and API tests and integrate them into CI/CD pipelines for daily releases.
- Perform manual and exploratory testing where automated coverage is incomplete, especially during releases.
- Establish QA quality instrumentation, including escaped-defect tracking, test plans, release criteria, and quality standards.
- Test and evaluate GenAI and LLM-powered features by building evaluation harnesses, ground-truth datasets, and scoring for non-deterministic outputs.
- Mentor two QA engineers and serve as the operational QA lead while remaining approximately 80% hands-on.
Requirements
- 6+ years of senior-level QA and test automation experience.
- Deep hands-on experience with Playwright, Cypress, or similar automation frameworks, plus API testing.
- Experience integrating automated tests into CI/CD pipelines; GitLab experience is beneficial.
- Experience building automated test coverage from partial or primarily manual coverage.
- Experience mentoring engineers or owning QA processes for a small team.
- Experience with Jira for test and defect management.
Nice to have
- Experience with AI-assisted testing, LLM-based test generation, or agentic and multi-agent systems.
- Experience delivering software in regulated or federal environments, including FedRAMP, CUI, or DoD programs.
- B2B SaaS, manufacturing, or supply-chain domain experience.
- Experience with data, analytics, ML, or model-output quality testing.
Culture & Benefits
- Join a small, high-trust QA team within engineering.
- Work in an environment transitioning from biweekly to daily releases.
- Full-time employees receive medical, dental, and vision coverage.
- Benefits include paid time off, company holidays, and 401(k) matching.
- Visa sponsorship is not available.
Будьте осторожны: если работодатель просит войти в их систему, используя iCloud/Google, прислать код/пароль, запустить код/ПО, не делайте этого - это мошенники. Обязательно жмите "Пожаловаться" или пишите в поддержку. Подробнее в гайде →
Похожие вакансии
13 часов назад
Senior AI Driven Automation QA Engineer (AI)
6 дней назад
Fullstack QA Engineer (AI)
6 дней назад
Senior Automation Engineer - SDET (AI)
15 часов назад
Software Test Automation Architect (AI)
172 000 - 270 000$
ZenCreator
8 часов назад
AI QA Engineer (QA Automation)
5 дней назад
QA Automation Engineer (AI)
100 000 - 130 000$