Software Engineer, Data Quality (AI)

Location: On-site in San Francisco or Singapore, with remote options in Asia or North America. Remote candidates must have 70–80% working-hours overlap with either San Francisco or Singapore time zones. Relocation and visa support is available for strong full-time candidates moving to the US or Singapore.

Company

hirify.global builds infrastructure for creating reinforcement-learning training data and evaluations for frontier AI agents, including a marketplace for frontier labs.

What you will do

• Build full-stack tools for reviewing tasks, inspecting agent trajectories, checking graders, and investigating data quality issues.
• Create dashboards and metrics covering quality trends, failure modes, and review and validation workflow health.
• Design backend services, APIs, and data workflows connecting quality checks with task creation, evaluation, and feedback to data creators.
• Work with Quality and Intelligence and research engineering teams to turn evolving review methods into scalable workflows.
• Move validated internal tools into production and improve their reliability, usability, and observability.
• Investigate issues in live workflows and use findings to prevent repeat failures.

Requirements

• Strong software engineering fundamentals across frontend, backend, and data systems.
• Proficiency in Python and a modern web stack such as TypeScript and React, or comparable tools.
• Experience building internal or user-facing products end-to-end, from workflow discovery through production improvement.
• Sound judgment about APIs, data models, and production systems, including reliability and debuggability.
• Ability to turn ambiguous quality problems into useful interfaces, automation, and measurable checks.
• Clear communication and close collaboration with research and quality teams.

Nice to have

• Experience with data review, annotation, evaluations, benchmarks, or machine-learning workflows.
• Experience with agent traces, graders, reward signals, or reinforcement-learning training data.
• Experience designing dashboards, observability tools, or review workflows for complex datasets and pipelines.
• Experience taking prototypes or internal tools into wider production use.

Culture & Benefits

• Full-time employment with competitive compensation.
• Support for relocation and visas to the US or Singapore for strong candidates.
• US employees receive fully covered medical, dental, and vision insurance, plus 401(k) and commuter benefits.
• Office employees receive lunch and dinner, and all employees receive a company-wide holiday break in addition to PTO and paid holidays.
• Access to AI development tools and additional perks including an Equinox membership.

Hiring process

• Rolling applications.
• Two technical interviews followed by a 2–3 day work trial.