HTTP/2 200 server: GitHub.com content-type: text/html; charset=utf-8 last-modified: Thu, 14 Sep 2023 09:21:03 GMT access-control-allow-origin: * strict-transport-security: max-age=31556952 etag: W/"6502d07f-9006" expires: Tue, 30 Dec 2025 08:47:00 GMT cache-control: max-age=600 content-encoding: gzip x-proxy-cache: MISS x-github-request-id: B897:2118F1:9C6261:AFC47A:69538F2B accept-ranges: bytes age: 0 date: Tue, 30 Dec 2025 08:37:00 GMT via: 1.1 varnish x-served-by: cache-bom-vanm7210022-BOM x-cache: MISS x-cache-hits: 0 x-timer: S1767083820.943969,VS0,VE204 vary: Accept-Encoding x-fastly-request-id: 254055a1f4fd2dedbc0a13cd0f39d35ce8a99fbf content-length: 4154

MagicEdit:

High-Fidelity Temporally Coherent Video Editing

Jun Hao Liew*,

Hanshu Yan*,

Jianfeng Zhang,

Zhongcong Xu,

Jiashi Feng

ByteDance Inc.   ^*Equal Contribution

arXiv Code

MagicEdit explicitly disentangles the learning of appearance and motion to achieve high-fidelity and temporally coherent video editing. It supports various editing applications, including video stylization, local editing, video-MagicMix and video outpainting.

Video stylization

Video stylization enables one to (1) transform the source video into a new video with a style-of- interest (e.g., realistic, cartoon), or (2) creating a new scene with different subject (e.g., dog → cat) and different background (e.g., living room → beach).

---

▶ Animals

---

Source video

"a monkey, playing on the coast, sea"

"a teddy bear, eating apple, green grassland with flowers"

Source video

"a cute cat, sitting on the ground"

"a labrador dog, sitting on the table"

Source video

"a husky dog, lying on the sands"

"a sea lion, lying on the ice, winter, snow"

---

▶ Objects

---

Source video

"a red car, moving on the road, autumn, maple leaves"

"a red car, moving on the road, mountain, green grass and trees"

Source video

"black and white biscuits, falling down sequentially"

"bricks, falling down sequentially"

Source video

"stools, moving on the railway track"

"white cupcakes, moving on the table"

---

▶ Scenes

---

Source video

"boats and buildings, floating in the space, stars"

"boats, floating on the sea, villas on the coastal"

Source video

"a submarine travelling in the sea, fish swimming"

"motorbike travelling in the tunnel, with graffiti on the wall"

Source video

"red train travelling, snow, winter"

"train travelling, japanese, Cherry blossoms"

---

▶ Human

---

Source video

"a pretty girl, pink dress, living room"

Source video

"a pretty girl, white dress, dark hair, flowers"

Source video

"a pretty girl, white singlet, dark pants, on the stage"

Source video

"a pretty girl, yellow dress, beach, coconut trees"

Source video

"a pretty girl, red dress, ballroom"

Source video

"a pretty girl, white dress, dark hair"

---

Local editing

MagicEdit also allows users to make local modification to the video while leaving other regions untouched (e.g., make the young lady wear glasses).

---

Source video

"a handsome man"

Source video

"wearing sunglasses"

Source video

"a handsome man"

Source video

"a senior lady"

Source video

"a young lady"

Source video

"a pretty girl"

---

Video-MagicMix

Similar to MagicMix, we can also mix two different concepts (e.g., rabbit and tiger) in the video domain to create a novel concept (e.g., a rabbit-alike tiger).

---

Source video

"+ tiger"

"+ piglet"

Source video

"+ tiger"

"+ cat"

---

Video Outpainting

MagicEdit also supports video outpainting task without any re-training.

---

Source video

Outpainted

Source video

Outpainted

Source video

Outpainted

"a handsome man, jogging, on the road, sunny"

"a cute dog, garden, flowers"

"a pretty girl, sunset"

"a pretty girl, grey t-shirt"

"an eagle, sea"

"a brown bear, forest"

---

Video outpainting with different ratios and prompts

---

Prompt = "a handsome man, jogging, on the road, trees, sunny"

Prompt + "long pants"

BibTeX

@inproceedings{liew2023magicedit,
    author = {Liew, Jun Hao and Yan, Hanshu and Zhang, Jianfeng and Xu, Zhongcong and Feng, Jiashi},
    title = {MagicEdit: High-Fidelity and Temporally Coherent Video Editing},
    booktitle={arXiv},
    year = {2023}
}