arXiv:1805.09822
Filtering and Mining Parallel Data in a Joint Multilingual Space
원문 초록
We learn a joint multilingual sentence embedding and use the distance between sentences in different languages to filter noisy parallel data and to mine for parallel data in large news collections. We are able to improve a competitive baseline on the WMT'14 English to German task by 0.3 BLEU by filtering out 25% of the training data. The same approach is used to mine additional bitexts for the WMT'14 system and to obtain competitive results on the BUCC shared task to identify parallel sentences in comparable corpora. The approach is generic, it can be applied to many language pairs and it is independent of the architecture of the machine translation system.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Intrinsic vs. Extrinsic Evaluation of Czech Sentence Embeddings: Semantic Relevance Doesn't Help with MT Evaluation
Contrastive Prompting Enhances Sentence Embeddings in LLMs through Inference-Time Steering
Factors affecting the in-context learning abilities of LLMs for dialogue state tracking
ConECT Dataset: Overcoming Data Scarcity in Context-Aware E-Commerce MT
Mechanistic Decomposition of Sentence Representations
Rethinking the Understanding Ability across LLMs through Mutual Information
토론
이 논문과 연결된 포럼 글이 아직 없습니다.