Short-Term and Long-Term Context Aggregation Network for Video Inpainting
원문 초록
Video inpainting aims to restore missing regions of a video and has many applications such as video editing and object removal. However, existing methods either suffer from inaccurate short-term context aggregation or rarely explore long-term frame information. In this work, we present a novel context aggregation network to effectively exploit both short-term and long-term frame information for video inpainting. In the encoding stage, we propose boundary-aware short-term context aggregation, which aligns and aggregates, from neighbor frames, local regions that are closely related to the boundary context of missing regions into the target frame. Furthermore, we propose dynamic long-term context aggregation to globally refine the feature map generated in the encoding stage using long-term frame features, which are dynamically updated throughout the inpainting process. Experiments show that it outperforms state-of-the-art methods with better inpainting results and fast inpainting speed.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
VideoPainter: Any-length Video Inpainting and Editing with Plug-and-Play Context Control
BIVDiff: A Training-Free Framework for General-Purpose Video Synthesis via Bridging Image and Video Diffusion Models
Let Your Video Listen to Your Music!
Transformer-based Image and Video Inpainting: Current Challenges and Future Directions
Lumiere: A Space-Time Diffusion Model for Video Generation
UVL2: A Unified Framework for Video Tampering Localization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.