Mise-en-Video: Fine-Grained 3D Control for Multi-Shot Video Generation
[Widzenie komputerowe] Autorzy: Yingshuang Zou, Xiaoyu Shi, Yawen Luo i 8 więcej
Recent advances in text-to-video generation have enabled high-fidelity single-shot synthesis, yet practical storytelling creation requires multi-shot videos with both strong inter-shot consistency and fine-grained controllability. Existing multi-shot video generation approaches achieve strong consistency but still fall short in controllability. In this paper, we propose Mise-en-Video (MeV), a highly controllable multi-shot video generation framework that allows video creators to conduct staging the multi-shot in the 3D space and then generate the corresponding multi-shot video. To achieve this, our framework combines a hierarchical attention mechanism for multi-level narrative consistency with 3D-aware layout guidance for precise, per-shot spatial control. To support training and evaluation, we develop standardized annotation pipelines and construct a 160K-video dataset with hierarchica…
- Kategoria arxiv
- cs.CV
- Kategoria
- Widzenie komputerowe