ALANET: Adaptive Latent Attention Network forJoint Video Deblurring and Interpolation
원문 초록
Existing works address the problem of generating high frame-rate sharp videos by separately learning the frame deblurring and frame interpolation modules. Most of these approaches have a strong prior assumption that all the input frames are blurry whereas in a real-world setting, the quality of frames varies. Moreover, such approaches are trained to perform either of the two tasks - deblurring or interpolation - in isolation, while many practical situations call for both. Different from these works, we address a more realistic problem of high frame-rate sharp video synthesis with no prior assumption that input is always blurry. We introduce a novel architecture, Adaptive Latent Attention Network (ALANET), which synthesizes sharp high frame-rate videos with no prior knowledge of input frames being blurry or not, thereby performing the task of both deblurring and interpolation. We hypothesize that information from the latent representation of the consecutive frames can be utilized to generate optimized representations for both frame deblurring and frame interpolation. Specifically, we employ combination of self-attention and cross-attention module between consecutive frames in the latent space to generate optimized representation for each frame. The optimized representation learnt using these attention modules help the model to generate and interpolate sharp frames. Extensive experiments on standard datasets demonstrate that our method performs favorably against various state-of-the-art approaches, even though we tackle a much more difficult problem.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Quantile-Based Randomized Kaczmarz for Corrupted Tensor Linear Systems
Video Deblurring by Sharpness Prior Detection and Edge Information
Adaptive High-Pass Kernel Prediction for Efficient Video Deblurring
Learning Truncated Causal History Model for Video Restoration
CMTA: Cross-Modal Temporal Alignment for Event-guided Video Deblurring
Rethinking Video Deblurring with Wavelet-Aware Dynamic Transformer and Diffusion Model
토론
이 논문과 연결된 포럼 글이 아직 없습니다.