Lead Software Test Automation Engineer (AI)

Location: Coppell, Texas, United States; hybrid with attendance 8 days per month

Salary: $89,600–$157,000 USD annually; eligible for bonus.

Company

hirify.global develops commercial software and provides products supported by software engineering, AI engineering, security, DevOps, and operations teams.

What you will do

• Define and own risk-based, multi-layer test automation strategy across UI, API, contract, component, integration, end-to-end, data, platform, and AI/agentic systems.
• Design scalable automation frameworks, standards, reusable components, diagnostics, reporting, test data practices, and maintainable reference implementations.
• Build validation for probabilistic AI outcomes using evaluation datasets, benchmark harnesses, threshold and rubric-based scoring, groundedness testing, robustness checks, and regression detection.
• Integrate automated validation into CI/CD through pull-request checks, scheduled suites, deployment gates, and release-readiness criteria.
• Improve speed, reliability, and diagnosability through parallelization, intelligent test selection, deterministic data, dependency control, observability, and disciplined retries.
• Lead technical design and code reviews, coach engineers, influence quality investments, and use telemetry, incidents, customer issues, and escaped-defect patterns to improve coverage.

Requirements

• Bachelor’s degree in Computer Science, Software Engineering, Information Systems, or a related field, or equivalent practical experience.
• 8+ years of software quality engineering or test automation experience, including significant ownership of automation frameworks, technical design, and strategy for complex commercial software.
• Hands-on experience building scalable automation across API, contract, integration, UI, data, and end-to-end layers.
• Strong programming skills in at least one modern language such as Java, Python, TypeScript/JavaScript, or C#.
• Experience with modern UI and API automation frameworks such as Playwright, Cypress, Selenium, REST Assured, SuperTest, Postman/Newman, or pytest.
• Experience integrating automated testing into CI/CD with GitHub Actions, Jenkins, or Azure DevOps, including quality gates and release-readiness criteria.
• Experience improving reliability and execution speed through flakiness reduction, parallelization, test selection, diagnostics, test data strategies, environment management, service virtualization, and dependency control for distributed systems.
• Hands-on experience validating AI/ML, generative AI, agentic, or other probabilistic product capabilities in production-oriented software, including evaluation harnesses, benchmark datasets, semantic or rubric-based scoring, groundedness, and regression evaluation.
• Practical experience with Agentic Product Development Lifecycle and Spec-Driven Development, including translating specifications and acceptance criteria into traceable automated validation.
• Working knowledge of security, performance, accessibility, resilience, reliability testing, test observability, telemetry, quality dashboards, root-cause analysis, and production feedback loops.
• Ability to lead through technical influence, establish standards, coach engineers, communicate technical and product risk, and balance delivery speed, coverage, reliability, maintainability, and business risk.

Nice to have

• Master’s degree in a relevant technical or business discipline.

Culture & Benefits

• Hybrid work requires attendance at the Coppell location 8 days per month.
• Benefits include medical, dental, and vision plans; 401(k); FSA/HSA; commuter benefits; tuition assistance; vacation and sick time; and paid parental leave.
• The role partners across Product, Software Engineering, AI Engineering, Security, DevOps, and Operations.
• Applicants may be required to appear onsite at a hirify.global office during recruitment, including in-person interviews.

Hiring process

• Interviews must be completed without AI tools, AI-generated responses, external prompts, or third-party support; such assistance may result in disqualification.
• Applicants should remove virtual backgrounds and participate in in-person interviews when requested.