Software Test Engineer (AI)

Location: Remote, United States residency required

Salary: USD $95,553–$143,329 per year

Company

hirify.global provides AI-powered decision intelligence solutions for national security, supply chain management, and digital identity.

What you will do

• Develop and maintain smoke, unit, integration, regression, and end-to-end tests across backend and platform workflows.
• Validate backend services, APIs, authentication, billing and token behavior, model routing, file parsing, MCP tools, passthrough APIs, and AI workflow execution.
• Design AI platform end-to-end tests covering prompts, model responses, streaming, tool calls, agents, orchestration, and provider compatibility.
• Test edge cases, malformed inputs, authorization boundaries, concurrency, failure modes, user isolation, sanitization, rate limits, and replay prevention.
• Improve test scalability, determinism, execution performance, test isolation, diagnostics, fixtures, mocks, test data, and CI feedback loops.
• Build test infrastructure that scales with the platform and expanding engineering team.

Requirements

• 5–8 years of software testing experience.
• Strong software engineering background with deep experience in automated test development.
• Experience testing backend services, APIs, distributed systems, and database-backed applications.
• Experience designing smoke, unit, integration, and end-to-end testing strategies.
• Experience improving CI test reliability, execution time, parallelization, test isolation, and failure observability.
• Must currently reside in the United States and be able to obtain clearance.

Nice to have

• Experience testing AI platforms, LLM applications, model gateways, agents, MCP tools, or workflow automation systems.
• Familiarity with Vertex AI, AWS Bedrock, Azure OpenAI, OpenAI GPT, Anthropic Claude, or Google Gemini.
• Experience with GitHub Actions, Docker, Kubernetes, observability tooling, PostgreSQL, and SQL.
• Knowledge of FedRAMP, NIST AI RMF, or CMMC 2.0.

Culture & Benefits

• Remote work arrangement for candidates residing in the United States.
• Work on AI platform reliability and complex decision-intelligence workflows.
• Collaboration with software engineers to define acceptance tests and improve release confidence.
• Compensation may vary based on skills, experience, education, certifications, location, and other factors.