Evaluating Byte and Wordpiece Level Models for Massively Multilingual Semantic Parsing
원문 초록
Token free approaches have been successfully applied to a series of word and span level tasks. In this work, we compare a byte-level (ByT5) and a wordpiece based (mT5) sequence to sequence model on the 51 languages of the MASSIVE multilingual semantic parsing dataset. We examine multiple experimental settings: (i) zero-shot, (ii) full gold data and (iii) zero-shot with synthetic data. By leveraging a state-of-the-art label projection method for machine translated examples, we are able to reduce the gap in exact match accuracy to only 5 points with respect to a model trained on gold data from all the languages. We additionally provide insights on the cross-lingual transfer of ByT5 and show how the model compares with respect to mT5 across all parameter sizes.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Cross-lingual Back-Parsing: Utterance Synthesis from Meaning Representation for Zero-Resource Semantic Parsing
Incorporating Lexical and Syntactic Knowledge for Unsupervised Cross-Lingual Transfer
Where, What, Why: Towards Explainable Driver Attention Prediction
The Devil Is in the Word Alignment Details: On Translation-Based Cross-Lingual Transfer for Token Classification Tasks
Sigma: A dataset for text-to-code semantic parsing with statistical analysis
Diverse In-Context Example Selection After Decomposing Programs and Aligned Utterances Improves Semantic Parsing
토론
이 논문과 연결된 포럼 글이 아직 없습니다.