Discourse Cohesion Evaluation for Document-Level Neural Machine Translation
원문 초록
It is well known that translations generated by an excellent document-level neural machine translation (NMT) model are consistent and coherent. However, existing sentence-level evaluation metrics like BLEU can hardly reflect the model's performance at the document level. To tackle this issue, we propose a Discourse Cohesion Evaluation Method (DCoEM) in this paper and contribute a new test suite that considers four cohesive manners (reference, conjunction, substitution, and lexical cohesion) to measure the cohesiveness of document translations. The evaluation results on recent document-level NMT systems show that our method is practical and essential in estimating translations at the document level.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ConECT Dataset: Overcoming Data Scarcity in Context-Aware E-Commerce MT
Combining the Best of Both Worlds: A Method for Hybrid NMT and LLM Translation
Do Not Change Me: On Transferring Entities Without Modification in Neural Machine Translation -- a Multilingual Perspective
Intrinsic vs. Extrinsic Evaluation of Czech Sentence Embeddings: Semantic Relevance Doesn't Help with MT Evaluation
Building a Functional Machine Translation Corpus for Kpelle
In-Domain African Languages Translation Using LLMs and Multi-armed Bandits
토론
이 논문과 연결된 포럼 글이 아직 없습니다.