← Zero-Shot Cross-Lingual Transfer
Papers with Code · CC BY-SA 4.0

XTREME

아카이브 평가 25건 · 마지막 적재/변경

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델원본 지표·값논문구현
Turing ULR v6
Sentence-pair Classification
91.0
Structured Prediction
83.8
Question Answering
77.1
Sentence Retrieval
94.4
Avg
85.5
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA
2021-06-30
코드 1 · 코드 2 · 코드 3
MShenNonG
Sentence-pair Classification
90.4
Structured Prediction
83.1
Question Answering
76.3
Sentence Retrieval
94.4
Avg
85.0
연결 없음
논문 날짜 미기재
연결 없음
MShenNonG+TDT
Sentence-pair Classification
90.4
Structured Prediction
83.1
Question Answering
76.3
Sentence Retrieval
94.4
Avg
85.0
연결 없음
논문 날짜 미기재
연결 없음
Turing ULR v5
Sentence-pair Classification
90.3
Structured Prediction
81.7
Question Answering
76.3
Sentence Retrieval
93.7
Avg
84.5
XLM-E: Cross-lingual Language Model Pre-training via ELECTRA
2021-06-30
코드 1 · 코드 2 · 코드 3
CoFe
Sentence-pair Classification
90.1
Structured Prediction
81.4
Question Answering
75.0
Sentence Retrieval
94.2
Avg
84.1
연결 없음
논문 날짜 미기재
연결 없음
Turing ULR v5 (XLM-E)
Sentence-pair Classification
90.0
Structured Prediction
81.4
Question Answering
74.3
Sentence Retrieval
93.7
Avg
83.7
연결 없음
논문 날짜 미기재
연결 없음
InfoXLM-XFT
Sentence-pair Classification
89.3
Structured Prediction
75.5
Question Answering
75.2
Sentence Retrieval
92.4
Avg
82.2
연결 없음
논문 날짜 미기재
연결 없음
Ensemble-Distil-XFT (ED-XFT)
Sentence-pair Classification
89.2
Structured Prediction
74.6
Question Answering
75.2
Sentence Retrieval
92.4
Avg
82.0
연결 없음
논문 날짜 미기재
연결 없음
VECO
Sentence-pair Classification
89.0
Structured Prediction
76.7
Question Answering
73.4
Sentence Retrieval
93.3
Avg
82.0
연결 없음
논문 날짜 미기재
연결 없음
VECO + HICTL
Sentence-pair Classification
89.0
Structured Prediction
76.7
Question Answering
73.4
Sentence Retrieval
93.3
Avg
82.0
연결 없음
논문 날짜 미기재
연결 없음
Polyglot
Sentence-pair Classification
88.3
Structured Prediction
80.6
Question Answering
71.9
Sentence Retrieval
90.8
Avg
81.7
연결 없음
논문 날짜 미기재
연결 없음
Unicoder+ZCode
Sentence-pair Classification
88.4
Structured Prediction
76.2
Question Answering
72.5
Sentence Retrieval
93.7
Avg
81.6
연결 없음
논문 날짜 미기재
연결 없음
Unicoder + ZCode
Sentence-pair Classification
88.4
Structured Prediction
76.2
Question Answering
72.5
Sentence Retrieval
93.7
Avg
81.6
연결 없음
논문 날짜 미기재
연결 없음
ERNIE-M
Sentence-pair Classification
87.9
Structured Prediction
75.6
Question Answering
72.3
Sentence Retrieval
91.9
Avg
80.9
ERNIE-M: Enhanced Multilingual Representation by Aligning Cross-lingual Semantics with Monolingual Corpora
2020-12-31
코드 1 · 코드 2
HiCTL
Sentence-pair Classification
89.0
Structured Prediction
74.4
Question Answering
71.9
Sentence Retrieval
92.6
Avg
80.8
연결 없음
논문 날짜 미기재
연결 없음
T-ULRv2 + StableTune
Sentence-pair Classification
88.8
Structured Prediction
75.4
Question Answering
72.9
Sentence Retrieval
89.3
Avg
80.7
InfoXLM: An Information-Theoretic Framework for Cross-Lingual Language Model Pre-Training
2020-07-15
코드 1 · 코드 2 · 코드 3 · 코드 4
Anonymous3
Sentence-pair Classification
88.2
Structured Prediction
74.6
Question Answering
71.7
Sentence Retrieval
89.0
Avg
79.9
연결 없음
논문 날짜 미기재
연결 없음
FILTER
Sentence-pair Classification
87.5
Structured Prediction
71.9
Question Answering
68.5
Sentence Retrieval
84.4
Avg
77.0
FILTER: An Enhanced Fusion Method for Cross-lingual Language Understanding
2020-09-10
코드 1
Creative
Sentence-pair Classification
86.3
Structured Prediction
90.8
Question Answering
59.7
Sentence Retrieval
77.5
Avg
76.5
연결 없음
논문 날짜 미기재
연결 없음
X-STILTs
Sentence-pair Classification
83.9
Structured Prediction
69.4
Question Answering
67.2
Sentence Retrieval
76.5
Avg
73.5
English Intermediate-Task Training Improves Zero-Shot Cross-Lingual Transfer Too
2020-05-26
연결 없음
RemBERT
Sentence-pair Classification
84.1
Structured Prediction
73.3
Question Answering
68.6
Sentence Retrieval
NA
Avg
56.1
연결 없음
논문 날짜 미기재
연결 없음
Anonymous5
Sentence-pair Classification
75.3
Structured Prediction
66.9
Question Answering
52.5
Sentence Retrieval
18.0
Avg
53.1
연결 없음
논문 날짜 미기재
연결 없음
mT5
Sentence-pair Classification
89.8
Structured Prediction
NA
Question Answering
73.6
Sentence Retrieval
NA
Avg
40.9
mT5: A massively multilingual pre-trained text-to-text transformer
2020-10-22
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8
Anonymous6
Sentence-pair Classification
44.2
Structured Prediction
0.0
Question Answering
65.5
Sentence Retrieval
34.5
Avg
39.3
연결 없음
논문 날짜 미기재
연결 없음
mBERT
AVG
59.6
Sentence-pair Classification
73.7
Structured Prediction
66.3
Question Answering
53.8
Sentence Retrieval
47.7
XTREME: A Massively Multilingual Multi-task Benchmark for Evaluating Cross-lingual Generalisation
논문 날짜 미기재
코드 1 · 코드 2