Multimodal LLM Researcher (AI)

TL;DR

Multimodal LLM Researcher (AI): Designing and building foundational technologies for real-time multimodal generation and agentic platforms with an accent on LLM, VLM, and Audio LM architectures. Focus on diffusion model distillation, world models, and orchestrating intelligent agentic systems for scalable multimedia experiences.

Location: Flexible on-site/remote hybrid (HQ in Palo Alto, CA)

Salary: $185,000 – $400,000

Company

hirify.global empowers creators by building state-of-the-art agentic and multimedia platforms to make real-time generative technology accessible to all.

What you will do

• Lead research in real-time multimodal generation (text, image, video, audio) and agentic platform infrastructure.
• Design and prototype novel algorithms for high-fidelity, real-time multimodal synthesis and interactive experiences.
• Develop diffusion model distillation and diffusion-based world models for multimodal applications.
• Train and finetune autoregressive and diffusion models for LLM, VLM, or Audio LM contexts with a focus on real-time performance.
• Curate high-quality multimodal datasets for video, audio, and sensory-rich data.
• Collaborate with cross-functional teams to integrate research advancements into production-ready technologies.

Requirements

• 5+ years of relevant experience in LLM, VLM, Audio LM, or deep learning.
• Demonstrated impact as first author in top-tier conferences such as NeurIPS, CVPR, ICML, ICCV, or SIGGRAPH.
• Deep expertise in language modeling, vision-language modeling, or audio language modeling.
• Experience with generative models (autoregressive and diffusion) and their real-time deployment.
• Strong programming skills in Python and frameworks like PyTorch or TensorFlow.
• Must be based in or able to work in a hybrid setup in Palo Alto, CA.

Culture & Benefits

• Competitive salary and substantial equity in a high-growth startup.
• Full health benefits and 401k matching.
• Collaborative, mission-driven team environment with major growth opportunities.
• Flexible on-site/remote hybrid work arrangement.