AI Evaluator (Small Business Operations)

Company

hirify.global is a boutique consultancy providing IT professional services and engineering talent solutions.

What you will do

• Create realistic prompts based on common small-business situations and goals.
• Interact with multiple AI chatbots and compare the quality of their responses.
• Evaluate AI-generated written and visual business content for accuracy, clarity, usefulness, and relevance.
• Assess workflows involving spreadsheets, PDFs, images, CRM processes, and other business documents.
• Provide structured feedback, scoring, evaluation reports, and conversation transcripts.
• Test AI handling of customer communication, operations, marketing, research, and financial-planning scenarios.

Requirements

• Fluent Japanese communication skills required.
• At least 2 years of experience as a business owner or in small-business operations.
• Strong understanding of day-to-day SMB workflows and customer interactions.
• Experience using chatbots or other generative AI tools.
• Ability to critically evaluate written and visual business content.
• Comfort working with spreadsheets, PDFs, images, and structured business documents.

Culture & Benefits

• Remote contractor assignment lasting 10 weeks.
• Commitment of 20–40 hours per week.
• Minimum 4 hours of PST overlap required.
• One short interview in the hiring process.
• Supporting business materials may be uploaded to create realistic AI evaluation prompts.