Senior Quality Assurance Engineer (AI)

TL;DR

Senior Quality Assurance Engineer (AI): Building and maintaining automated testing frameworks for an AI observability platform with an accent on data-intensive systems and complex backend workflows. Focus on ensuring calculation accuracy, validating data pipelines, and establishing quality standards in a fast-growing startup environment.

Location: Must be based in South America

Company

A fast-growing startup building an AI observability and analytics platform that transforms complex telemetry and operational data into actionable business insights.

What you will do

• Design and maintain automated test coverage for backend services, APIs, and data-processing workflows.
• Validate the accuracy of platform calculations, metrics, and reporting outputs.
• Create testing strategies for complex data pipelines and AI-related workflows.
• Define and maintain release quality gates to ensure reliable product deployments.
• Collaborate with engineering and product teams to proactively identify quality risks.
• Develop test datasets and validation mechanisms to detect data inconsistencies.

Requirements

• 5+ years of experience in Quality Assurance or Test Automation.
• Must be based in South America.
• English proficiency: Upper-intermediate (B2) or higher.
• Strong experience designing automated testing frameworks and API validation.
• Experience testing data-intensive systems or distributed applications.
• Ability to analyze complex workflows and identify quality risks.

Nice to have

• Experience with AI, LLM, or agent-based systems.
• Knowledge of observability frameworks like OpenTelemetry.
• Python proficiency for test automation.
• Experience with CI/CD pipelines and release automation.
• Background in early-stage startup environments.

Culture & Benefits

• 100% remote work environment.
• High degree of autonomy and ownership in a product-focused team.
• Direct collaboration with experienced engineering and product leadership.
• Exposure to cutting-edge AI technologies and modern architectures.
• Flexible working culture in a fast-moving, innovative environment.