AI Quality Assurance Architect

Location: Remote or in one of hirify.global's offices

Company

hirify.global is a global software development services provider delivering AI-driven solutions, cloud services, and data engineering for EdTech, FinTech, and HealthTech.

What you will do

• Own and evolve end-to-end test and quality architecture.
• Define test strategies covering APIs, integrations, automation, regression, performance, resilience, and production assurance.
• Establish automation frameworks, quality gates, release criteria, test-data strategies, and environment strategies.
• Implement BDD standards, including Gherkin scenarios and traceability from requirements to automated tests, and integrate BDD tests into CI/CD pipelines.
• Define AI/LLM testing approaches, evaluation datasets, regression suites, hallucination-risk controls, guardrails, and safety checks.
• Establish quality metrics, identify systemic risks, and coach QA teams while collaborating with stakeholders and technical leaders.

Requirements

• 10+ years of experience in software testing, quality engineering, or test architecture.
• Proven experience as a Test Architect, Quality Architect, Principal QA Engineer, or Senior Test Lead.
• Experience defining test strategies across complex enterprise systems and multiple teams.
• Strong knowledge of Agile, DevOps/DevSecOps, CI/CD, and automated quality gates.
• Hands-on experience with BDD, Gherkin, Given/When/Then scenarios, requirements traceability, and integrating automated BDD tests into CI/CD pipelines.
• Experience testing AI/LLM or agentic systems, including evaluation frameworks, regression testing, hallucination risks, guardrails, and safety.
• Strong knowledge of API, integration, contract, performance, and resilience testing.
• Experience with Python, Java, or JavaScript/TypeScript for automation.
• Strong stakeholder management and technical leadership skills.

Nice to have

• Experience with enterprise-scale transformation programmes.
• Knowledge of microservices, event-driven architectures, and API-first platforms.
• Experience with AWS, Azure, or GCP; data-quality testing; AI/ML, Generative AI, RAG, or agentic systems.
• Experience establishing quality standards across multiple teams or suppliers.
• Experience transitioning from manual QA to automated quality engineering.

Culture & Benefits

• Remote work or work from one of the company's offices.
• Flexible working schedule and a friendly, supportive atmosphere.
• 20 business days of covered vacation, 5 sick leave days, and 3 additional days off.
• Free English classes and legal support.
• Medical insurance for employees from Ukraine.