A Prior of a Googol Gaussians: a Tensor Ring Induced Prior for Generative Models
원문 초록
Generative models produce realistic objects in many domains, including text, image, video, and audio synthesis. Most popular models---Generative Adversarial Networks (GANs) and Variational Autoencoders (VAEs)---usually employ a standard Gaussian distribution as a prior. Previous works show that the richer family of prior distributions may help to avoid the mode collapse problem in GANs and to improve the evidence lower bound in VAEs. We propose a new family of prior distributions---Tensor Ring Induced Prior (TRIP)---that packs an exponential number of Gaussians into a high-dimensional lattice with a relatively small number of parameters. We show that these priors improve Fr\'echet Inception Distance for GANs and Evidence Lower Bound for VAEs. We also study generative models with TRIP in the conditional generation setup with missing conditions. Altogether, we propose a novel plug-and-play framework for generative models that can be utilized in any GAN and VAE-like architectures.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Fast Differentiable Modal Simulation of Non-linear Strings, Membranes, and Plates
Generative diffusion model with inverse renormalization group flows
MMAudio: Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis
OmniFlow: Any-to-Any Generation with Multi-Modal Rectified Flows
Where are we in audio deepfake detection? A systematic analysis over generative and detection models
ViolinDiff: Enhancing Expressive Violin Synthesis with Pitch Bend Conditioning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.