Business Analyst – AI Evaluation Specialist

Location: Remote, United States

Company

Boutique consultancy specializing in IT professional services and engineering talent solutions.

What you will do

• Gather, analyze, and document business requirements, stakeholder expectations, and project objectives.
• Compare chatbot responses and evaluate their accuracy, relevance, completeness, and alignment with defined criteria.
• Translate requirements into functional specifications, evaluation criteria, and actionable documentation.
• Analyze workflows, business processes, and data to identify gaps, inefficiencies, and improvement opportunities.
• Create reports, dashboards, process maps, and other project documentation.
• Support planning, testing, implementation, UAT, stakeholder collaboration, progress tracking, risk and dependency management, KPI tracking, and presentation of findings.

Requirements

• Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
• At least 3 years of professional experience as a Business Analyst or in a similar analytical role.
• Strong analytical thinking, problem-solving, and decision-making skills.
• Proficiency in Excel and experience with SQL, Power BI, Tableau, or comparable analytical and reporting tools.
• Experience gathering requirements, documenting functional specifications, and mapping business processes.
• Strong attention to detail and the ability to compare complex information against defined criteria.
• Excellent written communication, reporting, and documentation skills.
• Ability to collaborate with cross-functional teams and manage multiple priorities independently.
• Willingness to work five days per week, including weekends when required, with two weekdays off during the project.

Culture & Benefits

• Remote contract role.
• Work schedule includes five days per week, with weekends when required and two weekdays off during the project.
• Work contributes to improving the accuracy and usefulness of AI systems.