You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Download the weights of MotionCtrl motionctrl_svd.pth and put it to ./checkpoints.
Running scripts:
sh configs/inference/run.sh
Run local gradio demo
python -m app --share
βββ Noted βββ
If the motion control is not obvious, try to increase the speed in the run.sh or Motion Speed in the gradio demo.
If the generated videos are distored severely, try to descrease the speed in the run.sh or Motion Speed in the gradio demo. Or increase FPS.
π Citation
If you make use of our work, please cite our paper.
@inproceedings{wang2024motionctrl,
title={Motionctrl: A unified and flexible motion controller for video generation},
author={Wang, Zhouxia and Yuan, Ziyang and Wang, Xintao and Li, Yaowei and Chen, Tianshui and Xia, Menghan and Luo, Ping and Shan, Ying},
booktitle={ACM SIGGRAPH 2024 Conference Papers},
pages={1--11},
year={2024}
}
π€ Acknowledgment
The current version of MotionCtrl is built on SVD. We appreciate the authors for sharing their awesome codebase.
β Contact
For any question, feel free to email wzhoux@connect.hku.hk or zhouzi1212@gmail.com.