|
|
| CARVIEW |
Architecture
Presto utilizes LLMs to decouple text input into multiple progressive sub-captions. We propose a Segmented Cross-Attention mechanism to effectively incorporate these prompts concurrently.
LongTake-HD
Our LongTake-HD dataset has 261k instances, each comprising a content-rich video filtered from public sources, annotated with an overall video caption and five progressive sub-captions. We apply rigorous filtering criteria to ensure scenario coherence and content richness in videos.
Long Video
As the intensified dynamics decelerate via the interpolation model, our Presto can generate 15-second videos. However, adopting traditional interpolation models may result in artifacts, as the scenario motion is too significant to these models. A better way is to use image-conditioned video diffusion model, which we leave as our future work.