Few-Shot Domain Adaptation for Grammatical Error Correction via Meta-Learning
원문 초록
Most existing Grammatical Error Correction (GEC) methods based on sequence-to-sequence mainly focus on how to generate more pseudo data to obtain better performance. Few work addresses few-shot GEC domain adaptation. In this paper, we treat different GEC domains as different GEC tasks and propose to extend meta-learning to few-shot GEC domain adaptation without using any pseudo data. We exploit a set of data-rich source domains to learn the initialization of model parameters that facilitates fast adaptation on new resource-poor target domains. We adapt GEC model to the first language (L1) of the second language learner. To evaluate the proposed method, we use nine L1s as source domains and five L1s as target domains. Experiment results on the L1 GEC domain adaptation dataset demonstrate that the proposed approach outperforms the multi-task transfer learning baseline by 0.50 $F_{0.5}$ score on average and enables us to effectively adapt to a new L1 domain with only 200 parallel sentences.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
The Bayesian Approach to Continual Learning: An Overview
Cross-Domain Conditional Diffusion Models for Time Series Imputation
BotTrans: A Multi-Source Graph Domain Adaptation Approach for Social Bot Detection
Flowing Datasets with Wasserstein over Wasserstein Gradient Flows
Unleashing the Power of Intermediate Domains for Mixed Domain Semi-Supervised Medical Image Segmentation
Acquiring and Adapting Priors for Novel Tasks via Neural Meta-Architectures
토론
이 논문과 연결된 포럼 글이 아직 없습니다.