Automation Test Architect (Agentic AI)

TL;DR

Automation Test Architect (Agentic AI): Defining and leading enterprise-grade test automation strategy for UI, API, and platform layers with an accent on Agentic AI and LLM-based system validation. Focus on architecting scalable frameworks, implementing non-deterministic AI testing models, and driving engineering excellence across CI/CD pipelines.

Location: Must be based in or able to work onsite in Coppell, TX, USA

Compensation: $89,600–$157,000 USD

Company

hirify.global is a global provider of professional information, software solutions, and services for clinicians, accountants, lawyers, and tax, finance, audit, risk, compliance, and regulatory sectors.

What you will do

• Define and own the multi-layer test automation architecture and strategy.
• Design testing approaches for non-deterministic AI outputs, including hallucination detection and benchmark evaluation.
• Build and scale high-throughput automation projects to improve execution speed and reduce flakiness.
• Integrate automation into CI/CD pipelines with robust quality gates and observability.
• Serve as the QE technical authority, coaching engineers on automation design and best practices.
• Partner with ML/AI and Product teams to establish quality standards for AI capabilities.

Requirements

• 8–12+ years of experience in Quality Engineering or Test Automation with architect-level ownership.
• Strong programming skills in Java, Python, or TypeScript/JavaScript.
• Proven expertise in UI automation (Playwright/Cypress/Selenium) and API testing.
• Experience with CI/CD tools like GitHub Actions, Jenkins, or Azure DevOps.
• Must be able to appear onsite in Coppell, TX for interviews and work.
• Deep understanding of test pyramid, contract testing, and shift-left practices.

Nice to have

• Experience testing LLM/Agentic AI features, including semantic scoring and drift detection.
• Knowledge of security or performance testing integration.
• Experience building reusable automation libraries for multiple teams.

Culture & Benefits

• Comprehensive medical, dental, and vision insurance plans.
• 401(k) retirement savings plan with company contributions.
• FSA/HSA accounts and commuter benefits.
• Tuition assistance program for professional development.
• Generous vacation and sick time policies.
• Paid parental leave.

Hiring process

• Interviews are conducted in-person; virtual backgrounds are not permitted.
• Candidates must participate without the assistance of AI tools or external prompts.