DiVAE: Photorealistic Images Synthesis with Denoising Diffusion Decoder
원문 초록
Recently most successful image synthesis models are multi stage process to combine the advantages of different methods, which always includes a VAE-like model for faithfully reconstructing embedding to image and a prior model to generate image embedding. At the same time, diffusion models have shown be capacity to generate high-quality synthetic images. Our work proposes a VQ-VAE architecture model with a diffusion decoder (DiVAE) to work as the reconstructing component in image synthesis. We explore how to input image embedding into diffusion model for excellent performance and find that simple modification on diffusion's UNet can achieve it. Training on ImageNet, Our model achieves state-of-the-art results and generates more photorealistic images specifically. In addition, we apply the DiVAE with an Auto-regressive generator on conditional synthesis tasks to perform more human-feeling and detailed samples.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
fastWDM3D: Fast and Accurate 3D Healthy Tissue Inpainting
DiffusionBlocks: Blockwise Training for Generative Models via Score-Based Diffusion
Cost-Aware Routing for Efficient Text-To-Image Generation
ReFrame: Layer Caching for Accelerated Inference in Real-Time Rendering
Stochastic Solutions for Simultaneous Seismic Data Denoising and Reconstruction via Score-based Generative Models
Deep Conditional HDRI: Inverse Tone Mapping via Dual Encoder-Decoder Conditioning Method
토론
이 논문과 연결된 포럼 글이 아직 없습니다.