GAN-Based Multi-View Video Coding with Spatio-Temporal EPI Reconstruction
원문 초록
The introduction of multiple viewpoints in video scenes inevitably increases the bitrates required for storage and transmission. To reduce bitrates, researchers have developed methods to skip intermediate viewpoints during compression and delivery, and ultimately reconstruct them using Side Information (SI). Typically, depth maps are used to construct SI. However, their methods suffer from inaccuracies in reconstruction and inherently high bitrates. In this paper, we propose a novel multi-view video coding method that leverages the image generation capabilities of Generative Adversarial Network (GAN) to improve the reconstruction accuracy of SI. Additionally, we consider incorporating information from adjacent temporal and spatial viewpoints to further reduce SI redundancy. At the encoder, we construct a spatio-temporal Epipolar Plane Image (EPI) and further utilize a convolutional network to extract the latent code of a GAN as SI. At the decoder side, we combine the SI and adjacent viewpoints to reconstruct intermediate views using the GAN generator. Specifically, we establish a joint encoder constraint for reconstruction cost and SI entropy to achieve an optimal trade-off between reconstruction quality and bitrates overhead. Experiments demonstrate significantly improved Rate-Distortion (RD) performance compared with state-of-the-art methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
HybridQ: Hybrid Classical-Quantum Generative Adversarial Network for Skin Disease Image Generation
Generation of Indian Sign Language Letters, Numbers, and Words
CoReGAN: Contrastive Regularized Generative Adversarial Network for Guided Depth Map Super Resolution
Deep Conditional HDRI: Inverse Tone Mapping via Dual Encoder-Decoder Conditioning Method
ArcGAN: Generative Adversarial Networks for 3D Architectural Image Generation
LSegDiff: A Latent Diffusion Model for Medical Image Segmentation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.