Senior QA Automation Engineer (AI/AWS)

TL;DR

Senior QA Automation Engineer (AI/AWS): Building and validating automated quality systems for AI-enabled assessment and orchestration services with an accent on test strategy, security, CI/CD, and data-oriented validation. Focus on designing agentic AI testing approaches, creating mock services, integrating AWS components, and solving reliability challenges for large-scale education platforms.

Location: Fully remote within the United States; candidates near hirify.global offices may choose a hybrid schedule with in-office work on Tuesdays and Wednesdays. Travel to the New York City or Reston, Virginia office is required 3–5 times per year. Authorization to work in the United States is required.

Salary: $153,000–$166,000 per year

Company

A self-sustaining nonprofit organization focused on expanding educational and career opportunities through large-scale assessment programs and technology services.

What you will do

• Design and implement automated testing strategies, quality metrics, and validation gates, including agentic AI approaches.
• Decompose product capabilities into functional changes for verification and provide guidance on functional, data, and security risks.
• Create mock services and reusable automated entry and exit points for independent quality validation.
• Build and maintain solutions using Agile, CI/CD, DevOps, and secure engineering practices.
• Lead or participate in peer reviews, Agile ceremonies, production issue resolution, and SDLC process design.
• Collaborate with product owners, architects, and engineers on feature evaluation, estimates, benchmarking, and planning.

Requirements

• 7+ years of experience in software systems, testing, quality assurance, and scripting or development.
• Experience with quality tools such as Cucumber, Jest, and Postman, plus test doubles including stubs, fakes, shims, and mocks.
• Experience applying AI to software development and testing, with a basic understanding of performance testing.
• Experience testing code and scripts in Amazon Web Services environments, including Lambda, Step Functions, S3, and DynamoDB.
• Experience with CI/CD, DevOps, infrastructure access controls, and Agile methodologies.
• Must be authorized to work in the United States and able to travel to New York City or Reston 3–5 times per year.

Nice to have

• Experience developing processes for agentic-centered development.
• Experience pitching and implementing improved systems and processes.

Culture & Benefits

• Mission-driven nonprofit environment focused on educational and career opportunities.
• Fully remote work option across the United States, with hybrid flexibility for candidates near offices.
• Competitive, location-adjusted compensation based on qualifications, experience, impact, and market data.
• Supportive, collaborative environment with continuous learning, feedback, and professional growth.
• Transparent discussions about compensation and benefits throughout the hiring process.

Hiring process

• Resume and application review followed by a recruiter phone or video screen.
• Hiring manager interview, performance exercise such as live coding, and panel interview.
• Leadership conversation and reference checks.