AI QA Engineer

Location: Remote from Armenia

Company

A remote-first product design, engineering, and marketing studio founded in 2012 that builds AI-powered web and mobile applications for major brands, startups, and research organizations.

What you will do

• Define acceptance criteria and determine what correct output means when requirements are incomplete or probabilistic.
• Design test plans, scenarios, and checklists for AI-powered features.
• Perform manual functional, regression, and exploratory testing across web and mobile applications.
• Evaluate AI outputs for hallucinations, incomplete retrieval, confidently wrong answers, prompt sensitivity, and failure to apply business rules.
• Inspect REST API requests and responses using browser DevTools or Postman.
• Document reproducible defects and collaborate with developers, product managers, and AI engineers.

Requirements

• At least 1.5 years of experience in QA or software engineering.
• Strong knowledge of QA processes, methodologies, terminology, test planning, test cases, SDLC, and regression testing.
• Experience with manual testing of web and mobile applications.
• Comfort working with REST APIs and browser DevTools to inspect application behavior.
• Upper-Intermediate English is required for daily communication with international clients.
• Ability to form hypotheses, define acceptance criteria, question results, and resolve ambiguity through testing.

Nice to have

• Basic SQL or the ability to query data directly.
• Knowledge of LLMs, RAG pipelines, or AI chatbots.
• Experience testing role-based access control.

Culture & Benefits

• Twenty days of paid annual vacation during the first three years, increasing to 25 days later.
• Paid sick leave, 10 national holidays, and two company days off.
• Well-being budget and health insurance allowance.
• Maternity and paternity leave, accounting assistance, and hardware based on business needs.
• Reimbursement of professional development courses and certifications up to 100% with manager approval.
• Positive engineering culture with a close-knit team and clear processes.

Hiring process

• HR interview.
• Technical interview with the QA Team Lead and QA Manual Engineer.
• Offer.