AI Agent Tester (Real-World Tasks)

Location: Remote, must be based in the United States

Salary: $30–$50 per hour

Company

hirify.global provides the AI Agent Tester project.

What you will do

• Test two AI agents on shopping, bookings, bill payments, returns, email follow-ups, travel, and online forms.
• Approve or stop agents at important decision points.
• Screen-record every task attempt using a smartphone.
• Score performance based on completion, quality, user control, satisfaction, and time.
• Provide clear written feedback on the overall user experience.

Requirements

• Must be based in the United States.
• Bachelor's degree required.
• 2–3 years of professional experience, preferably in engineering, business management, or operations.
• Regular use of AI tools in daily life.
• Strong attention to detail, written communication, and documentation skills.
• An active personal AI assistant account with Plus tier, active Muse and Dots access, and a smartphone with screen-recording capability.
• A payment card for reimbursable test purchases.
• No coding or AI technical background is required; generalists are welcome and domain experts are preferred.

Culture & Benefits

• Remote, flexible work performed entirely from a phone.
• Approximately 1.5 hours per task run, including evidence collection and scoring.
• Opportunity to work with AI tools and evaluate real-world performance.
• Opportunity to help improve next-generation AI agents.

Hiring process

• Apply and complete the screening questions.
• Attend a 15–30-minute interview and complete the profile review.
• Receive onboarding instructions from the Talent Operations team within 24–48 hours of selection.