Fine Grained Human Evaluation for English-to-Chinese Machine Translation: A Case Study on Scientific Text
원문 초록
Recent research suggests that neural machine translation (MT) in the news domain has reached human-level performance, but for other professional domains, it is far below the level. In this paper, we conduct a fine-grained systematic human evaluation for four widely used Chinese-English NMT systems on scientific abstracts which are collected from published journals and books. Our human evaluation results show that all the systems return with more than 10\% error rates on average, which requires much post editing effort for real academic use. Furthermore, we categorize six main error types and and provide some real examples. Our findings emphasise the needs that research attention in the MT community should be shifted from short text generic translation to professional machine translation and build large scale bilingual corpus for these specific domains.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Do Not Change Me: On Transferring Entities Without Modification in Neural Machine Translation -- a Multilingual Perspective
Calibrating Translation Decoding with Quality Estimation on LLMs
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation
ConECT Dataset: Overcoming Data Scarcity in Context-Aware E-Commerce MT
In-Domain African Languages Translation Using LLMs and Multi-armed Bandits
THOR-MoE: Hierarchical Task-Guided and Context-Responsive Routing for Neural Machine Translation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.