Senior QA Gen AI

TL;DR

Senior QA Gen AI: Ensuring the quality of AI-powered applications and services with an accent on testing Large Language Models (LLMs) and Retrieval-Augmented Generation (RAG) models. Focus on defining testing strategies, creating test cases, and using QA integration tools to maintain high availability and security.

Location: Availability for hybrid work, 3 times a week in Lisbon.

Company

hirify.global focuses on finding the perfect match between their Rhinos and clients, offering access to a network of national and international partners across diverse sectors of the tech industry.

What you will do

• Create and define testing strategies for AI-powered applications.
• Use QA integration tools such as Postman or SOAP UI.
• Ensure high availability and security of event-driven systems.
• Work with microservices and distributed systems.

Requirements

• Solid knowledge of .NET (preferred) or Java.
• Experience working with microservices and distributed systems.
• Background in QA, including test case creation and definition of testing strategies.
• Experience using QA integration tools such as Postman or SOAP UI.
• Hands-on experience with LLMs and related protocols.
• Practical experience with Retrieval-Augmented Generation (RAG) models and embeddings.
• Availability for hybrid work, 3 times a week in Lisbon.

Nice to have

• Experience with event-driven and high-availability systems.
• Knowledge of communication protocols such as gRPC, SOAP, and JSON-RPC.
• Experience with event-driven architecture (EDA) and the use of event brokers (e.g. Kafka).
• Practical knowledge of API security, including OAuth2, JWT, and zero-trust principles.
• Familiarity with observability tools and standards such as OpenTelemetry.

Culture & Benefits

• Opportunities for career progression.
• Health insurance.
• Coverflex meal card.
• Personalized support with career coach.