Senior Machine Learning Engineer (Healthcare)

TL;DR

Senior Machine Learning Engineer (VLM/Computer Vision): Designing and iterating on VLM-based pipelines to generate high-quality labels and annotations at scale with an accent on prompt engineering, fine-tuning, and edge-to-cloud data strategies. Focus on optimizing VLM accuracy through contextual feature selection and building robust evaluation frameworks for model performance.

Location: Remote (US or Canada), NYC preferred

Salary: $200,000–$230,000 + equity

Company

hirify.global provides a connected ecosystem in senior living, integrating technology and compassionate care to improve clinical and operational outcomes.

What you will do

• Design and iterate on VLM-based pipelines for scalable, high-quality label generation.
• Define data-forwarding strategies from edge devices to optimize VLM accuracy and reduce ambiguity.
• Collaborate with Embedded Systems and Hardware teams on device-side preprocessing and data-forwarding.
• Build robust evaluation frameworks to measure label quality, model accuracy, and regression detection.
• Benchmark and integrate commercial and open-source VLMs to stay current with vision-language capabilities.

Requirements

• 5+ years of experience in ML engineering, specifically in computer vision and LLM/VLM systems.
• Hands-on experience with VLMs such as GPT-4V, Claude, Gemini, or LLaVA.
• Proficiency in Python, PyTorch, and cloud inference APIs.
• Experience building scalable labeling systems and cloud-based inference infrastructure.
• Must be based in the US or Canada.

Nice to have

• Experience with video or spatiotemporal data (multi-frame reasoning).
• Familiarity with edge computing and on-device ML pipelines.
• Domain experience in healthcare or senior living.

Culture & Benefits

• Competitive annual salary with equity and comprehensive medical, dental, and vision benefits.
• Flexible PTO.
• Opportunity to drive work independently in a fast-moving, early-stage startup environment.