Information Extraction Engineer (AI)

Location: Remote, USA; occasional travel of up to 25% to DEFCON AI HQ, customer sites, and vendor facilities.

Salary: $135,000–$170,000 per year, plus bonus and equity package.

Company

hirify.global is an incubation firm building technology-led companies in healthcare, cyber, and national security; DEFCON AI develops AI-enabled decision-support technology for resilient optimization of complex systems.

What you will do

• Own the system test plan covering functional, integration, performance, and load testing, and translate product acceptance criteria into executable tests.
• Build automated test suites, integrate them into CI/CD release gates, establish coverage standards, and maintain regression coverage.
• Plan customer user acceptance testing and track findings through resolution.
• Build labeled evaluation sets, design sampled audits, and measure incorrect decisions, system misses, and user overrides.
• Maintain version inventories, test reports, evaluation records, rollback criteria, and audit-ready release evidence.
• Hold release gates independently and verify that test environments sufficiently match production.

Requirements

• 5+ years in software quality engineering, test automation, or software engineering with substantial dedicated test ownership.
• Clear point of view on testing practices and the judgment to establish standards as the first dedicated quality engineering hire.
• Strong coding ability in a test automation language and framework, such as Python with pytest or JavaScript/TypeScript with Playwright, Cypress, or Selenium; ability to read and reason about application code.
• Routine use of AI-assisted development with judgment about generated output and verification.
• Experience building automated test suites, integrating them into CI/CD release gates, and owning a test plan through review and acceptance.
• Experience testing against requirements rather than implementation, including direct work with product owners or end users to define correctness.
• Experience with performance and load testing, statistical literacy including sampling design, and measuring what a system misses.
• Ability to report unfavorable results independently, gate work owned by non-reporting teams, hold releases, and produce clear audit-ready documentation.
• US citizenship, active US Secret clearance, favorable investigation, and CAC eligibility required from the start. Elevated security requirements apply to part of the work.
• Willingness to travel up to 25% as required.

Nice to have

• Active Top Secret clearance and experience in government DevSecOps, RMF, or ATO environments.
• Contract and API testing, test data management, and extensible test infrastructure.
• AI-assisted testing, including language-model-generated coverage and meaningful-test validation.
• JMeter, k6, Locust, or comparable performance tools.
• Machine-learning or model-output evaluation, including groundedness, citation checking, and user disagreement analysis.
• Model cards, NIST AI RMF, responsible AI practices, Section 508, or WCAG verification.
• Experience testing systems where incorrect results carry real cost or require external review.

Culture & Benefits

• Fully remote, results-based environment with flexible workday management.
• 100% employer-paid medical, dental, and vision insurance for employees and families.
• Unlimited PTO with manager approval and 14 weeks of fully paid parental leave.
• Professional development opportunities, optional 401(k), FSA, equity incentives, and mental health benefits.
• Competitive salary, bonus, and equity package.