Member of Technical Staff, Coding Agent Research & Evaluations (AI)

Location: Remote, US

Salary: $200,000–$260,000 USD base salary annually, plus potential equity and performance-based bonuses.

Company

hirify.global presents a remote-first AI and software role focused on coding-agent research and evaluation.

What you will do

• Design and own evaluation frameworks, benchmark specifications, scoring methodologies, rubrics, and quality standards for coding agents.
• Lead research initiatives measuring and improving coding-model performance across software engineering tasks.
• Develop datasets, golden examples, evaluation protocols, tooling, and infrastructure for large-scale experimentation and review workflows.
• Analyze model behavior and failure modes and translate findings into improvements for training and evaluation.
• Establish rigorous, reproducible coding-agent assessment practices and measurement standards.
• Collaborate with researchers, engineers, and applied AI teams; contribute to technical reports, benchmark studies, and client-facing research initiatives.

Requirements

• Strong software engineering background with expertise in Python, C++, or comparable programming languages.
• 3+ years of experience in software engineering, machine learning, AI research, evaluation, or related technical disciplines.
• Experience designing, reviewing, or validating technical assessments, benchmarks, coding tasks, or evaluation methodologies.
• Familiarity with large language models, coding agents, reinforcement learning, model evaluation, or related AI systems.
• Ability to build tooling, automate workflows, and improve technical processes through systematic experimentation.
• Strong analytical skills for investigating model behavior and deriving insights from complex technical systems.
• Excellent written and verbal communication skills for explaining technical findings to diverse audiences.
• Comfort working in fast-moving research environments with ambiguity and evolving priorities.

Nice to have

• Experience with frontier AI systems, coding agents, or model evaluation research.
• Interest in how data, evaluations, and feedback mechanisms influence model capabilities.
• Track record of independently driving ambiguous technical or research projects from conception to execution.
• Experience designing benchmarks or datasets for machine learning systems at scale.
• Familiarity with agentic workflows, tool use, reinforcement learning, or post-training methodologies.
• Publications, open-source contributions, or demonstrated technical leadership in AI, machine learning, or software engineering.

Culture & Benefits

• Full-time, remote-first position.
• Health-insurance premium reimbursement of up to 100%.
• Paid time off and a 401(k) plan with company match.
• Potential equity compensation and performance-based bonuses subject to company policies.
• AI tools assist with candidate screening and assessment while complementing human decision-making.