Training Bi-Encoders for Word Sense Disambiguation
원문 초록
Modern transformer-based neural architectures yield impressive results in nearly every NLP task and Word Sense Disambiguation, the problem of discerning the correct sense of a word in a given context, is no exception. State-of-the-art approaches in WSD today leverage lexical information along with pre-trained embeddings from these models to achieve results comparable to human inter-annotator agreement on standard evaluation benchmarks. In the same vein, we experiment with several strategies to optimize bi-encoders for this specific task and propose alternative methods of presenting lexical information to our model. Through our multi-stage pre-training and fine-tuning pipeline we further the state of the art in Word Sense Disambiguation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SANDWiCH: Semantical Analysis of Neighbours for Disambiguating Words in Context ad Hoc
Fietje: An open, efficient LLM for Dutch
LexMatcher: Dictionary-centric Data Collection for LLM-based Machine Translation
Do Pretrained Contextual Language Models Distinguish between Hebrew Homograph Analyses?
3AM: An Ambiguity-Aware Multi-Modal Machine Translation Dataset
PejorativITy: Disambiguating Pejorative Epithets to Improve Misogyny Detection in Italian Tweets
토론
이 논문과 연결된 포럼 글이 아직 없습니다.