LinguaLinker: Audio-Driven Portraits Animation with Implicit Facial Control Enhancement

Rui Zhang*, Yixiao Fang*, Zhengnan Lu, Pei Cheng, Zebiao Huang, Bin Fu

* Equal contributions

Official repository of "LinguaLinker: Audio-Driven Portraits Animation with Implicit Facial Control Enhancement".

🎞 Showcases

Implicit Frequency Control

👨:low 👄:high 👀:low	👨:low 👄:high 👀:high	👨:high 👄:low 👀:low	👨:high 👄:high 👀:high
ControlExample.mp4

Multilingual Results

ChineseSong.mp4

FrenchSong.mp4

EnglishSong.mp4

JapaneseSong.mp4

ChineseTalk.mp4

EnglishTalk.mp4

More results are demonstrated in our project page.

🌟 Changelog

• [2024.7.29] 🔥🔥 LinguaLinker: Technical Report\
• [2024.7.12] Initial update