Code Data Quality Specialist (AI)

TL;DR

Code Data Quality Specialist (AI): Reviewing and auditing code annotations to ensure high-quality training data for AI models with an accent on data validation and internal tooling development. Focus on building automation scripts, troubleshooting developer environments, and refining annotation guidelines.

Location: On-site in Paris or London. Visa sponsorship is available.

Company

hirify.global develops frontier open-source AI models for enterprises and consumers to democratize intelligence.

What you will do

• Generate and validate high-quality code annotations based on rubrics for AI model development and evaluation.
• Identify systemic issues, edge cases, and gaps in annotation guidelines to improve data quality.
• Build and maintain internal automation tools, such as visualization dashboards and configuration scripts.
• Provide technical support to annotators by troubleshooting CLI, Git, and local environment issues.
• Collaborate with technical program managers and engineers to refine data production processes.

Requirements

• Degree in Computer Science or 2-5 years of professional experience in software engineering or technical support.
• Proficiency in Python, JavaScript, or similar languages with the ability to reason about code across multiple languages.
• Comfortable with Unix-like terminals, shell basics, and Git workflows (branches, merges, conflict resolution).
• Ability to apply consistent judgment against a rubric and maintain focus during high-volume review work.
• Professional proficiency in English (strong writing and comprehension).

Nice to have

• Experience in data annotation for LLM training (SFT, RLHF) or agentic data.
• Experience building and training annotation teams through interviews.
• Deep domain depth in frontend, backend, DevOps, or MLOps.
• Familiarity with inter-annotator agreement and quality measurement metrics.

Culture & Benefits

• Competitive cash salary and equity.
• Full health insurance for employees and their families.
• Daily lunch vouchers and monthly mobility pass contribution.
• Monthly Gympass subscription contribution.
• Generous parental leave policy and visa sponsorship.