Redefining part-of-speech classes with distributional semantic models
원문 초록
This paper studies how word embeddings trained on the British National Corpus interact with part of speech boundaries. Our work targets the Universal PoS tag set, which is currently actively being used for annotation of a range of languages. We experiment with training classifiers for predicting PoS tags for words based on their embeddings. The results show that the information about PoS affiliation contained in the distributional vectors allows us to discover groups of words with distributional patterns that differ from other words of the same part of speech. This data often reveals hidden inconsistencies of the annotation process or guidelines. At the same time, it supports the notion of `soft' or `graded' part of speech affiliations. Finally, we show that information about PoS is distributed among dozens of vector components, not limited to only one or two features.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
myNER: Contextualized Burmese Named Entity Recognition with Bidirectional LSTM and fastText Embeddings via Joint Training with POS Tagging
A Comparative Analysis of Static Word Embeddings for Hungarian
LingoLoop Attack: Trapping MLLMs via Linguistic Context and State Entrapment into Endless Loops
Comparative Study of Zero-Shot Cross-Lingual Transfer for Bodo POS and NER Tagging Using Gemini 2.0 Flash Thinking Experimental Model
Author-Specific Linguistic Patterns Unveiled: A Deep Learning Study on Word Class Distributions
Exploring transfer learning for Deep NLP systems on rarely annotated languages
토론
이 논문과 연결된 포럼 글이 아직 없습니다.