To lemmatize or not to lemmatize: how word normalisation affects ELMo performance in word sense disambiguation
원문 초록
We critically evaluate the widespread assumption that deep learning NLP models do not require lemmatized input. To test this, we trained versions of contextualised word embedding ELMo models on raw tokenized corpora and on the corpora with word tokens replaced by their lemmas. Then, these models were evaluated on the word sense disambiguation task. This was done for the English and Russian languages. The experiments showed that while lemmatization is indeed not necessary for English, the situation is different for Russian. It seems that for rich-morphology languages, using lemmatized training and testing data yields small but consistent improvements: at least for word sense disambiguation. This means that the decisions about text pre-processing before training ELMo should consider the linguistic nature of the language in question.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SinaTools: Open Source Toolkit for Arabic Natural Language Processing
ParsiPy: NLP Toolkit for Historical Persian Texts in Python
SANDWiCH: Semantical Analysis of Neighbours for Disambiguating Words in Context ad Hoc
Fietje: An open, efficient LLM for Dutch
A State-of-the-Art Morphosyntactic Parser and Lemmatizer for Ancient Greek
One Model is All You Need: ByT5-Sanskrit, a Unified Model for Sanskrit NLP Tasks
토론
이 논문과 연결된 포럼 글이 아직 없습니다.