Can Multilingual Language Models Transfer to an Unseen Dialect? A Case Study on North African Arabizi
원문 초록
Building natural language processing systems for non standardized and low resource languages is a difficult challenge. The recent success of large-scale multilingual pretrained language models provides new modeling tools to tackle this. In this work, we study the ability of multilingual language models to process an unseen dialect. We take user generated North-African Arabic as our case study, a resource-poor dialectal variety of Arabic with frequent code-mixing with French and written in Arabizi, a non-standardized transliteration of Arabic to Latin script. Focusing on two tasks, part-of-speech tagging and dependency parsing, we show in zero-shot and unsupervised adaptation scenarios that multilingual language models are able to transfer to such an unseen dialect, specifically in two extreme cases: (i) across scripts, using Modern Standard Arabic as a source language, and (ii) from a distantly related language, unseen during pretraining, namely Maltese. Our results constitute the first successful transfer experiments on this dialect, paving thus the way for the development of an NLP ecosystem for resource-scarce, non-standardized and highly variable vernacular languages.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
GR-NLP-TOOLKIT: An Open-Source NLP Toolkit for Modern Greek
Step-by-step Instructions and a Simple Tabular Output Format Improve the Dependency Parsing Accuracy of LLMs
ParsiPy: NLP Toolkit for Historical Persian Texts in Python
Advancing Hungarian Text Processing with HuSpaCy: Efficient and Accurate NLP Pipelines
Taqyim: Evaluating Arabic NLP Tasks Using ChatGPT Models
BRENT: Bidirectional Retrieval Enhanced Norwegian Transformer
토론
이 논문과 연결된 포럼 글이 아직 없습니다.