Software Test Engineer (AI)

TL;DR

Software Test Engineer (AI): Building and strengthening automated validation for an AI platform with an accent on backend regression coverage and system-level validation. Focus on designing scalable E2E tests for complex AI workflows, improving CI feedback loops, and ensuring platform reliability.

Location: Remote (United States). Candidate must have the ability to obtain a Secret clearance.

Company

hirify.global is a leading provider of AI-powered decision intelligence solutions specializing in national security, supply chain management, and digital identity.

What you will do

• Develop and maintain smoke, unit, integration, and end-to-end tests across backend and platform workflows.
• Build regression coverage for edge cases, authorization boundaries, concurrency issues, and failure modes.
• Design E2E tests for AI platform workflows, optimizing for token usage, latency, and cost.
• Improve the scalability, determinism, and diagnostic quality of the test suite and CI feedback loops.
• Validate backend APIs, authentication flows, model routing, and agentic harnesses.
• Build and maintain test infrastructure that scales with the growing product surface area.

Requirements

• Experience: 2-5 years of Software Testing experience with a strong software engineering background.
• Deep experience in automated test development for backend services, APIs, and distributed systems.
• Proven ability to design comprehensive smoke, unit, integration, and E2E testing strategies.
• Experience improving CI test reliability, execution time, and parallelization.
• Strong troubleshooting, analytical, and communication skills.
• Must be able to obtain a Secret clearance.

Nice to have

• Experience writing E2E tests for LLM applications, model gateways, or AI agents.
• Familiarity with GenAI provider APIs such as Google VertexAI, AWS Bedrock, or Azure OpenAI.
• Experience with GitHub Actions, Docker, Kubernetes, and observability tooling.
• Proficiency with PostgreSQL and SQL for data validation.
• Knowledge of government compliance frameworks (FedRAMP, NIST AI RMF, CMMC 2.0).

Culture & Benefits

• Opportunity to work with cutting-edge AI and decision intelligence technologies.
• Remote-first work environment.
• Role within a public company (NYSE: BBAI) serving critical national security missions.
• Commitment to equal opportunity employment.