Neural Semi-Markov Conditional Random Fields for Robust Character-Based Part-of-Speech Tagging
원문 초록
Character-level models of tokens have been shown to be effective at dealing with within-token noise and out-of-vocabulary words. But these models still rely on correct token boundaries. In this paper, we propose a novel end-to-end character-level model and demonstrate its effectiveness in multilingual settings and when token boundaries are noisy. Our model is a semi-Markov conditional random field with neural networks for character and segment representation. It requires no tokenizer. The model matches state-of-the-art baselines for various languages and significantly outperforms them on a noisy English version of a part-of-speech tagging benchmark dataset. Our code and the noisy dataset are publicly available at http://cistern.cis.lmu.de/semiCRF.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Step-by-step Instructions and a Simple Tabular Output Format Improve the Dependency Parsing Accuracy of LLMs
A Comparative Analysis of Static Word Embeddings for Hungarian
ParsiPy: NLP Toolkit for Historical Persian Texts in Python
GR-NLP-TOOLKIT: An Open-Source NLP Toolkit for Modern Greek
POS-tagging to highlight the skeletal structure of sentences
How Does A Text Preprocessing Pipeline Affect Ontology Syntactic Matching?
토론
이 논문과 연결된 포럼 글이 아직 없습니다.