AI Quality Architect (LLM)

TL;DR

AI Quality Architect (AI/LLM): Designing and implementing end-to-end quality architecture for agentic SDLC pipelines with an accent on AI-native test engineering and autonomous quality gates. Focus on building LLM-powered test generation platforms, risk-scoring models for CI/CD, and behavioral testing frameworks for non-deterministic AI agents.

Location: Hybrid in Raanana, Israel (2 days office, 3 days remote)

Company

hirify.global is a global leader in AI-powered customer experience and financial crime software used by Fortune 100 corporations.

What you will do

• Design the end-to-end quality architecture for agentic SDLC pipelines, covering requirement analysis, code generation, and autonomous deployment.
• Architect and own an LLM-powered test generation platform utilizing RAG and advanced prompt engineering standards.
• Build intelligent, adaptive quality gates and risk-scoring models that reason about risk for agentic CI/CD pipelines.
• Develop behavioral testing frameworks and drift detection systems for validating AI agents and LLM features in production.
• Establish trust and verification models for agent-produced artifacts to ensure all outputs are auditable and traceable.
• Collaborate with ML platform and data science teams to define quality acceptance criteria for models promoted to production.

Requirements

• 12+ years in software engineering with strong depth across development and quality engineering.
• 4+ years as a principal architect or distinguished engineer with cross-organizational technical scope.
• Direct production experience building and shipping systems that incorporate LLMs or AI agents.
• Expert-level proficiency in Python and TypeScript, and proficiency in at least one compiled language (Java, Go, or C#).
• Deep understanding of agentic AI patterns, including multi-agent orchestration, tool use, and memory architectures.
• Experience with modern test frameworks (Playwright, pytest) and cloud-native infrastructure (Docker, Kubernetes, AWS).

hirify.global-to-have">hirify.global to have

• Enterprise SaaS or platform engineering background.
• Experience working within regulated, high-uptime environments.

Culture & Benefits

• hirify.global-FLEX hybrid model allowing 3 days of remote work and 2 days in the office per week.
• Fast-paced, collaborative, and creative environment within a market-disrupting global company.
• Extensive internal career opportunities across various roles, disciplines, and locations.