Data Annotation Specialist (AI)

TL;DR

Data Annotation Specialist (AI): Evaluating and improving AI model performance on complex data science and coding tasks with an accent on debugging code, analyzing agent trajectories, and assessing logical flow. Focus on labeling and proofreading software engineering outputs to enhance model accuracy and reliability in real-world business applications.

Location: Must be based in Canada

Company

hirify.global is a leading security-first enterprise AI company building frontier foundation models and end-to-end products to solve real-world business problems.

What you will do

• Evaluate model responses to coding requests, workflows, and technical questions.
• Assess agent trajectories for code generation, debugging, and data manipulation.
• Prompt models to complete complex data science tasks and review output accuracy.
• Label, proofread, and improve machine-written and human-written software engineering outputs.
• Report quality and performance trends related to model behavior and project assignments.

Requirements

• Must be based in Canada
• 3+ years of relevant industry experience in data science and pipelines.
• Proficiency in Python and data science packages like numpy, pandas, and matplotlib.
• Strong understanding of SQL syntax and data formats (JSON, XML, YAML, HTML).
• Experience re-writing, proofreading, and providing feedback on code.
• Ability to commit to a minimum of 16 hours per week.

Nice to have

• Familiarity with code agents like OpenCode, Claude Code, or Codex.
• Experience evaluating agent trajectories.

Culture & Benefits

• Flexible independent contractor role with control over work methods.
• Opportunity to work with multiple clients simultaneously.
• Exposure to cutting-edge frontier AI model development.
• Inclusive and diverse work environment.

Hiring process

• Resume and writing sample review.
• Virtual annotation test including data science assessment.
• Video screen with the Operations Team.