arXiv:2205.14539

Improving VAE-based Representation Learning

Mingtian Zhang, Tim Z. Xiao, Brooks Paige, David Barber

제출 2022-05-28

원문 초록

Latent variable models like the Variational Auto-Encoder (VAE) are commonly used to learn representations of images. However, for downstream tasks like semantic classification, the representations learned by VAE are less competitive than other non-latent variable models. This has led to some speculations that latent variable models may be fundamentally unsuitable for representation learning. In this work, we study what properties are required for good representations and how different VAE structure choices could affect the learned properties. We show that by using a decoder that prefers to learn local features, the remaining global features can be well captured by the latent, which significantly improves performance of a downstream classification task. We further apply the proposed model to semi-supervised learning tasks and demonstrate improvements in data efficiency.

함께 살펴볼 논문

공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.

arXiv:2506.19133공통 태그 Decoder, Representation Learning공식 코드 · Papers with Code

Riemannian generative decoder

토론

이 논문과 연결된 포럼 글이 아직 없습니다.