Distributed representation of multi-sense words: A loss-driven approach
원문 초록
Word2Vec's Skip Gram model is the current state-of-the-art approach for estimating the distributed representation of words. However, it assumes a single vector per word, which is not well-suited for representing words that have multiple senses. This work presents LDMI, a new model for estimating distributional representations of words. LDMI relies on the idea that, if a word carries multiple senses, then having a different representation for each of its senses should lead to a lower loss associated with predicting its co-occurring words, as opposed to the case when a single vector representation is used for all the senses. After identifying the multi-sense words, LDMI clusters the occurrences of these words to assign a sense to each occurrence. Experiments on the contextual word similarity task show that LDMI leads to better performance than competing approaches.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Analyzing Continuous Semantic Shifts with Diachronic Word Similarity Matrices
LGDE: Local Graph-based Dictionary Expansion
A Likelihood Ratio Test of Genetic Relationship among Languages
Are ELECTRA's Sentence Embeddings Beyond Repair? The Case of Semantic Textual Similarity
Visual Grounding Helps Learn Word Meanings in Low-Data Regimes
Improving Heterogeneous Graph Learning with Weighted Mixed-Curvature Product Manifold
토론
이 논문과 연결된 포럼 글이 아직 없습니다.