Mid-Level QA Analyst (AI/ML Systems Validation)

Location: Porto, Portugal — hybrid work with up to 2 remote days per week. Candidates must have an existing legal right to work in the European Union.

Company

hirify.global supports delivery for a leading financial institution’s innovative business unit.

What you will do

• Develop test strategies, test plans, and manual or exploratory test cases for AI/ML systems.
• Validate model accuracy, fairness, explainability, robustness, prediction quality, and data pipeline integrity.
• Assess data quality and contribute to success metrics such as precision, recall, and model bias.
• Analyze user stories, estimate testing effort, and challenge AI model requirements with Product Owners.
• Track and report defects in Jira and Xray, supporting defect resolution and UAT activities.
• Collaborate with stakeholders and UAT teams while participating in Scrum ceremonies, sprint planning, and backlog refinement.

Requirements

• At least 4 years of experience as a QA Analyst testing complex applications in Agile environments.
• Strong knowledge of API testing with Postman or SoapUI and SQL data validation.
• Practical experience testing AI/ML models, understanding model accuracy metrics, and validating data pipelines.
• Proficiency with Jira and Xray for test management.
• Python or another scripting language for test data preparation.
• Fluent English and an existing legal right to work in the European Union are required.

Nice to have

• Fluent or working proficiency in French.
• Experience with Selenium or Playwright.
• Background in Data Science, Computer Science, or Software Engineering.

Culture & Benefits

• Hybrid work arrangement in Porto with up to 2 remote days per week.
• Work on AI-powered applications for a financial institution’s innovative business unit.
• Opportunity to contribute to high-impact AI validation across functional reliability, fairness, robustness, and performance.