Domain Adaptation and Multi-Domain Adaptation for Neural Machine Translation: A Survey
원문 초록
The development of deep learning techniques has allowed Neural Machine Translation (NMT) models to become extremely powerful, given sufficient training data and training time. However, systems struggle when translating text from a new domain with a distinct style or vocabulary. Fine-tuning on in-domain data allows good domain adaptation, but requires sufficient relevant bilingual data. Even if this is available, simple fine-tuning can cause overfitting to new data and `catastrophic forgetting' of previously learned behaviour. We concentrate on robust approaches to domain adaptation for NMT, particularly where a system may need to translate across multiple domains. We divide techniques into those revolving around data selection or generation, model architecture, parameter adaptation procedure, and inference procedure. We finally highlight the benefits of domain adaptation and multi-domain adaptation techniques to other lines of NMT research.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
In-Domain African Languages Translation Using LLMs and Multi-armed Bandits
TopicVD: A Topic-Based Dataset of Video-Guided Multimodal Machine Translation for Documentaries
TULUN: Transparent and Adaptable Low-resource Machine Translation
Do Not Change Me: On Transferring Entities Without Modification in Neural Machine Translation -- a Multilingual Perspective
ConECT Dataset: Overcoming Data Scarcity in Context-Aware E-Commerce MT
THOR-MoE: Hierarchical Task-Guided and Context-Responsive Routing for Neural Machine Translation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.