Joint PoS Tagging and Stemming for Agglutinative Languages
원문 초록
The number of word forms in agglutinative languages is theoretically infinite and this variety in word forms introduces sparsity in many natural language processing tasks. Part-of-speech tagging (PoS tagging) is one of these tasks that often suffers from sparsity. In this paper, we present an unsupervised Bayesian model using Hidden Markov Models (HMMs) for joint PoS tagging and stemming for agglutinative languages. We use stemming to reduce sparsity in PoS tagging. Two tasks are jointly performed to provide a mutual benefit in both tasks. Our results show that joint POS tagging and stemming improves PoS tagging scores. We present results for Turkish and Finnish as agglutinative languages and English as a morphologically poor language.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Comparative Analysis of Static Word Embeddings for Hungarian
POS-tagging to highlight the skeletal structure of sentences
How Does A Text Preprocessing Pipeline Affect Ontology Syntactic Matching?
J2N -- Nominal Adjective Identification and its Application
ToPro: Token-Level Prompt Decomposition for Cross-Lingual Sequence Labeling Tasks
Multi-Task Learning for Front-End Text Processing in TTS
토론
이 논문과 연결된 포럼 글이 아직 없습니다.