xSIM++: An Improved Proxy to Bitext Mining Performance for Low-Resource Languages
원문 초록
We introduce a new proxy score for evaluating bitext mining based on similarity in a multilingual embedding space: xSIM++. In comparison to xSIM, this improved proxy leverages rule-based approaches to extend English sentences in any evaluation set with synthetic, hard-to-distinguish examples which more closely mirror the scenarios we encounter during large-scale mining. We validate this proxy by running a significant number of bitext mining experiments for a set of low-resource languages, and subsequently train NMT systems on the mined data. In comparison to xSIM, we show that xSIM++ is better correlated with the downstream BLEU scores of translation systems trained on mined bitexts, providing a reliable proxy of bitext mining performance without needing to run expensive bitext mining pipelines. xSIM++ also reports performance for different error types, offering more fine-grained feedback for model development.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Are We Paying Attention to Her? Investigating Gender Disambiguation and Attention in Machine Translation
Do Not Change Me: On Transferring Entities Without Modification in Neural Machine Translation -- a Multilingual Perspective
Calibrating Translation Decoding with Quality Estimation on LLMs
Beyond Decoder-only: Large Language Models Can be Good Encoders for Machine Translation
AFRIDOC-MT: Document-level MT Corpus for African Languages
Sinhala Transliteration: A Comparative Analysis Between Rule-based and Seq2Seq Approaches
토론
이 논문과 연결된 포럼 글이 아직 없습니다.