HTTP/2 200 server: GitHub.com content-type: text/html; charset=utf-8 last-modified: Wed, 05 Feb 2025 02:25:13 GMT access-control-allow-origin: * strict-transport-security: max-age=31556952 etag: W/"67a2cc09-1de8" expires: Mon, 29 Dec 2025 02:28:44 GMT cache-control: max-age=600 content-encoding: gzip x-proxy-cache: MISS x-github-request-id: F0FB:2680BD:8238F8:92660F:6951E503 accept-ranges: bytes age: 0 date: Mon, 29 Dec 2025 02:18:44 GMT via: 1.1 varnish x-served-by: cache-bom-vanm7210021-BOM x-cache: MISS x-cache-hits: 0 x-timer: S1766974724.227905,VS0,VE214 vary: Accept-Encoding x-fastly-request-id: b7b6cab9686b851edcdfb702d9a2b3868d81a7b0 content-length: 2091

MagicTalk: Implicit and Explicit Correlation Learning for Diffusion-based

Emotional Talking Face Generation

Chenxu Zhang^1*,

Chao Wang^1*,

Jianfeng Zhang¹,

Hongyi Xu¹,

Guoxian Song¹,

You Xie¹,

Linjie Luo¹,

Yapeng Tian²,

Jiashi Feng¹,

Xiaohu Guo²,

  ¹Bytedance Inc.   ²The University of Texas at Dallas

Video Results

---

▶ Qualitative Comparisons with MakeitTalk, SadTalker, EAMM and PD-FGC

---

▶ Qualitative Comparisons with EVP

Applications

---

▶ More Characters

Results with Real Human Faces and AIGC-generated Faces.

---

▶ Multiple Emotions

Results with Various Emotions, Such as Anger, Happy, and Surprise.

---

▶ A Conversation Across Time and Space

Leonardo predominantly expresses anger, while Mona Lisa exhibits happiness.

---

▶ Generation of Different Languages

Multiple Language Support for Emotional Talking Faces Generation, Including Chinese, Japanese, French, German, etc.

BibTeX

@inproceedings{magictalk2025,
    title = {MagicTalk: Implicit and Explicit Correlation Learning for Diffusion-based Emotional Talking Face Generation},
    authors = {Zhang, Chenxu and Wang, Chao and Zhang, Jianfeng and Xu, Hongyi and Song, Guoxian and Xie, You and Luo, Linjie and Tian, Yapeng and Feng, Jiashi and Guo, Xiaohu },
    year={2025}
}