Guided Generative Adversarial Neural Network for Representation Learning and High Fidelity Audio Generation using Fewer Labelled Audio Data
원문 초록
Recent improvements in Generative Adversarial Neural Networks (GANs) have shown their ability to generate higher quality samples as well as to learn good representations for transfer learning. Most of the representation learning methods based on GANs learn representations ignoring their post-use scenario, which can lead to increased generalisation ability. However, the model can become redundant if it is intended for a specific task. For example, assume we have a vast unlabelled audio dataset, and we want to learn a representation from this dataset so that it can be used to improve the emotion recognition performance of a small labelled audio dataset. During the representation learning training, if the model does not know the post emotion recognition task, it can completely ignore emotion-related characteristics in the learnt representation. This is a fundamental challenge for any unsupervised representation learning model. In this paper, we aim to address this challenge by proposing a novel GAN framework: Guided Generative Neural Network (GGAN), which guides a GAN to focus on learning desired representations and generating superior quality samples for audio data leveraging fewer labelled samples. Experimental results show that using a very small amount of labelled data as guidance, a GGAN learns significantly better representations.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
These are Not All the Features You are Looking For: A Fundamental Bottleneck In Supervised Pretraining
EfficientFER: EfficientNetv2 Based Deep Learning Approach for Facial Expression Recognition
Graph-Enhanced Emotion Neural Decoding
Multi-modal Siamese Network for Entity Alignment
FOIT: Fast Online Instance Transfer for Improved EEG Emotion Recognition
Multimodal Emotion Recognition with Transformer-Based Self Supervised Feature Fusion
토론
이 논문과 연결된 포럼 글이 아직 없습니다.