Part of speech tagging for code switched data
원문 초록
We address the problem of Part of Speech tagging (POS) in the context of linguistic code switching (CS). CS is the phenomenon where a speaker switches between two languages or variants of the same language within or across utterances, known as intra-sentential or inter-sentential CS, respectively. Processing CS data is especially challenging in intra-sentential data given state of the art monolingual NLP technology since such technology is geared toward the processing of one language at a time. In this paper we explore multiple strategies of applying state of the art POS taggers to CS data. We investigate the landscape in two CS language pairs, Spanish-English and Modern Standard Arabic-Arabic dialects. We compare the use of two POS taggers vs. a unified tagger trained on CS data. Our results show that applying a machine learning framework using two state of the art POS taggers achieves better performance compared to all other approaches that we investigate.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
A Comparative Analysis of Static Word Embeddings for Hungarian
POS-tagging to highlight the skeletal structure of sentences
How Does A Text Preprocessing Pipeline Affect Ontology Syntactic Matching?
J2N -- Nominal Adjective Identification and its Application
ToPro: Token-Level Prompt Decomposition for Cross-Lingual Sequence Labeling Tasks
Multi-Task Learning for Front-End Text Processing in TTS
토론
이 논문과 연결된 포럼 글이 아직 없습니다.