Synthesizing Monolingual Data for Neural Machine Translation
원문 초록
In neural machine translation (NMT), monolingual data in the target language are usually exploited through a method so-called "back-translation" to synthesize additional training parallel data. The synthetic data have been shown helpful to train better NMT, especially for low-resource language pairs and domains. Nonetheless, large monolingual data in the target domains or languages are not always available to generate large synthetic parallel data. In this work, we propose a new method to generate large synthetic parallel data leveraging very small monolingual data in a specific domain. We fine-tune a pre-trained GPT-2 model on such small in-domain monolingual data and use the resulting model to generate a large amount of synthetic in-domain monolingual data. Then, we perform back-translation, or forward translation, to generate synthetic in-domain parallel data. Our preliminary experiments on three language pairs and five domains show the effectiveness of our method to generate fully synthetic but useful in-domain parallel data for improving NMT in all configurations. We also show promising results in extreme adaptation for personalized NMT.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Do Not Change Me: On Transferring Entities Without Modification in Neural Machine Translation -- a Multilingual Perspective
Calibrating Translation Decoding with Quality Estimation on LLMs
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation
ConECT Dataset: Overcoming Data Scarcity in Context-Aware E-Commerce MT
In-Domain African Languages Translation Using LLMs and Multi-armed Bandits
THOR-MoE: Hierarchical Task-Guided and Context-Responsive Routing for Neural Machine Translation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.