PhD Research Intern - Emotional Speech Generation

Location: Onsite in the Beijing office, China

Company

Entertainment technology organization developing innovations across audio, video, music, gaming, and immersive media.

What you will do

• Design and implement controllable multimodal emotional speech generation systems.
• Research and apply diffusion models, flow matching, and related generative approaches for emotion-aware dialogue editing.
• Build emotion conditioning modules using text, reference speech, and facial-expression inputs.
• Align multimodal inputs into a shared emotion embedding space.
• Conduct literature reviews, experiments, analysis, and hands-on model development with research collaborators.
• Contribute to patents and academic publications while pursuing state-of-the-art results.

Requirements

• PhD candidate status is strongly preferred in deep learning for speech and audio processing.
• Hands-on experience with emotional or expressive speech generation, TTS, speech editing, or expressive speech synthesis.
• Practical understanding of generative models such as diffusion models, flow matching, GANs, or VAEs.
• Experience with Transformer-based, spoken-language, audio, or multimodal language models.
• Strong programming skills in Python and PyTorch.
• Good written communication skills in English and the ability to analyze and communicate complex information.

Nice to have

• Experience with speech disentanglement for speaker identity, linguistic content, and speaking style or emotion.
• Multimodal learning experience involving text, audio, and image modalities.
• Publications in relevant conferences or journals such as ICASSP, INTERSPEECH, NeurIPS, ICLR, ICML, or ACL.
• Research experience in speech emotion transfer, emotional speech synthesis, or dialogue generation.

Culture & Benefits

• Collaborative culture with challenging research and technology projects.
• Access to resources across audio, video, AR/VR, gaming, music, and movie technologies.
• Flexible work approach designed to support different ways of working, with this role based onsite in Beijing.
• Compensation and benefits are offered for the position.