Medical Evaluation Specialist (AI)

Location: Remote

Company

hirify.global is an IT consulting company.

What you will do

• Create and validate high-difficulty medical question-and-answer pairs covering diagnosis, pathophysiology, pharmacology, clinical guidelines, and clinical decision-making.
• Research and verify answers using primary literature, clinical guidelines, systematic reviews, and authoritative medical references.
• Document answer rationales with appropriate supporting citations.
• Evaluate AI-generated responses for clinical accuracy, completeness, reasoning quality, and adherence to evidence.
• Identify ambiguity, unsupported assumptions, factual errors, and inconsistencies, then refine questions while maintaining clinical validity.
• Incorporate reviewer feedback and help establish rigorous benchmarks for medical AI evaluation.

Requirements

• Medical training or equivalent expertise in a relevant biomedical discipline.
• Strong research, source triangulation, medical literature review, and evidence synthesis skills.
• Strong written English with exceptional attention to detail.
• Clinical reasoning, analytical thinking, written precision, and the ability to create medically defensible content.
• Ability to work independently, manage deadlines, and meet minimum weekly task requirements.

Nice to have

• Current or recent experience as a medical student, resident, or physician.
• Experience with medical question writing, peer review, clinical education, medical content evaluation, or research.
• Familiarity with AI/ML systems, AI evaluation, or medical AI applications.

Culture & Benefits

• Remote contractor engagement with output-based compensation paid per task meeting project specifications and quality standards.
• Task duration may vary based on experience and individual workflow.
• Selected contributors are expected to begin assignments within 24–48 hours after onboarding.
• Roles are typically filled within 48 hours.