arXiv:1707.06957

Reconstruction of Word Embeddings from Sub-Word Parameters

Karl Stratos

제출 2017-07-21

원문 초록

Pre-trained word embeddings improve the performance of a neural model at the cost of increasing the model size. We propose to benefit from this resource without paying the cost by operating strictly at the sub-lexical level. Our approach is quite simple: before task-specific training, we first optimize sub-word parameters to reconstruct pre-trained word embeddings using various distance measures. We report interesting results on a variety of tasks: word similarity, word analogy, and part-of-speech tagging.

함께 살펴볼 논문

공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.

arXiv:2403.01309공통 태그 Part-Of-Speech Tagging, Word Embeddings공식 코드 · Papers with Code

VNLP: Turkish NLP Package

토론

이 논문과 연결된 포럼 글이 아직 없습니다.