QA Automation Engineer (AI)

Location: Remote, United States only; all applicants must currently reside in the United States.

Salary: USD $95,553–$143,329 per year.

Company

hirify.global provides AI-powered decision intelligence solutions for national security, supply chain management, and digital identity.

What you will do

• Translate product requirements and customer workflows into acceptance criteria, testable outcomes, and risk-based coverage.
• Design, implement, and maintain Playwright automation for critical user journeys, regressions, APIs, integrations, and backend boundaries.
• Test conversational AI workflows, including streaming responses, document retrieval, citations, model selection, tool execution, interruptions, timeouts, and partial failures.
• Build evaluation datasets and scoring criteria for AI response accuracy, grounding, instruction following, and safe handling of requests.
• Integrate automation into CI/CD, investigate flaky tests, manage fixtures and isolated test data, and provide actionable failure diagnostics.
• Validate authentication, authorization, data isolation, rate limits, input sanitization, replay prevention, AI infrastructure, and provider-facing APIs while communicating release readiness and residual risks.

Requirements

• Current United States residency is required.
• 4+ years of QA automation engineering experience.
• Experience building and maintaining Playwright tests with fixtures, resilient locators, assertions, network handling, and trace-based debugging.
• Strong TypeScript or JavaScript coding skills and experience reviewing changes through Git.
• Experience with API testing, CI/CD integration, test isolation, and troubleshooting across browser, application, and backend boundaries.
• Ability to obtain a Department of Defense Secret clearance; experience testing authentication, authorization, permissions, and customer data separation.

Nice to have

• Experience testing LLM applications, retrieval-augmented generation, AI agents, model gateways, MCP tools, or workflow automation platforms.
• Python experience for API testing, utilities, test data generation, or AI evaluation workflows.
• Experience with government or enterprise platforms, auditable test evidence, and compliance frameworks such as FedRAMP, NIST AI RMF, or CMMC 2.0.
• Knowledge of cloud AI provider APIs and models, Docker, Kubernetes, observability tooling, PostgreSQL, and SQL.
• Active DoD Secret clearance or higher.

Culture & Benefits

• Remote work arrangement for candidates residing in the United States.
• Work on AI-powered solutions for national security, supply chain management, and digital identity.
• Close collaboration with Product and Engineering on release decisions and customer-impact analysis.
• Work in an environment where auditability, security, and government compliance are part of everyday delivery.