Self-Enhancing Multi-filter Sequence-to-Sequence Model
원문 초록
Representation learning is important for solving sequence-to-sequence problems in natural language processing. Representation learning transforms raw data into vector-form representations while preserving their features. However, data with significantly different features leads to heterogeneity in their representations, which may increase the difficulty of convergence. We design a multi-filter encoder-decoder model to resolve the heterogeneity problem in sequence-to-sequence tasks. The multi-filter model divides the latent space into subspaces using a clustering algorithm and trains a set of decoders (filters) in which each decoder only concentrates on the features from its corresponding subspace. As for the main contribution, we design a self-enhancing mechanism that uses a reinforcement learning algorithm to optimize the clustering algorithm without additional training data. We run semantic parsing and machine translation experiments to indicate that the proposed model can outperform most benchmarks by at least 5\%. We also empirically show the self-enhancing mechanism can improve performance by over 10\% and provide evidence to demonstrate the positive correlation between the model's performance and the latent space clustering.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Riemannian generative decoder
Boosting Team Modeling through Tempo-Relational Representation Learning
Graph Regularized and Feature Aware Matrix Factorization for Robust Incomplete Multi-view Clustering
Simultaneous Linear Multi-view Attributed Graph Representation Learning and Clustering
Representation Learning through Multimodal Attention and Time-Sync Comments for Affective Video Content Analysis
Robust Diversified Graph Contrastive Network for Incomplete Multi-view Clustering
토론
이 논문과 연결된 포럼 글이 아직 없습니다.