Medical Expert (AI Safety)

Location: United States (Remote)

Company

hirify.global develops AI-enhanced solutions for clinical accuracy and quality, including red teaming, trust and safety, clinical trial monitoring, and expert data annotation for LLM builders.

What you will do

• Roleplay medical and health-related scenarios with AI agents and evaluate the accuracy, clarity, safety, appropriateness, and potential harm of AI-generated health information.
• Red-team medical edge cases, unsafe guidance, model failure modes, patient distress, medical risk, and urgency escalation.
• Develop and refine medical rubrics, behavioral taxonomies, evaluation frameworks, safety metrics, and health policy feedback.
• Conduct qualitative analysis of health-related AI conversations and document edge cases, near-misses, and failure patterns.
• Collaborate with engineers, researchers, and clinicians in interdisciplinary review and calibration sessions.
• Maintain strict confidentiality, quality assurance standards, and ethical guidelines while working with sensitive or high-risk content.

Requirements

• Graduate-level training, past or current, in medicine, nursing, public health, or a related clinical field.
• Clinical experience evaluating or managing acute, chronic, or complex medical conditions.
• Strong understanding of medical ethics, patient safety, and risk communication.
• Fluency in English and at least one additional language.
• Familiarity with AI tools, LLMs, or clinical decision-support technologies.
• Ability to work remotely using Slack, LLM tools, and Google Docs.
• Comfort with ambiguity, evolving guidelines, and feedback-driven work.
• Willingness to sign NDAs and work with sensitive or high-risk content.
• Availability for up to 10 hours per week and occasional scheduled meetings.

Nice to have

• Completed degree and active licensure.
• 5+ years of clinical or applied medical experience.
• Experience in emergency medicine, primary care, specialty care, or public health.
• Experience working with a broad range of cultures or across international healthcare systems.
• Background in health communication, medical education, or patient-facing content.
• Trust and safety, content moderation, or medical data labeling experience.
• Interest in AI, NLP, or ML applications in healthcare.
• Experience reviewing or developing clinical guidelines or protocols.
• Membership in online communities such as Discord, Reddit, or professional forums.

Culture & Benefits

• Remote contract work supporting confidential initiatives focused on AI safety, health information quality, and medical risk mitigation.
• Work focused on protecting patients, caregivers, and people managing acute, chronic, or complex health conditions.
• Opportunity to work across multiple languages and cultural contexts at the intersection of medicine and emerging technology.
• Work includes evolving guidelines, feedback-driven collaboration, and interdisciplinary review.