Papers with Code · CC BY-SA 4.0

Natural Language Inference

545 평가 기록 52 datasets

Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".

Example:

Premise Label Hypothesis
A man inspects the uniform of a figure in some East Asian country. contradiction The man is sleeping.
An older and younger man smiling. neutral Two men are smiling and laughing at the cats playing on the floor.
A soccer game with multiple males playing. entailment Some men are playing a sport.

Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.

Further readings:

개요는 각 항목의 일부입니다. 위 탭에서 전체 기록을 페이지별로 탐색할 수 있습니다.

벤치마크

Papers with Code 아카이브의 데이터셋별 기록 예시입니다. 평가 조건과 지표 방향이 검증되지 않아 순위를 의미하지 않습니다.

Dataset기록된 모델 예시MetricPaperCode
UnitedSynT5 (3B)
% Test Accuracy: 94.7
논문 -
RTE
Vega v2 6B (KD-based prompt transfer)
Accuracy: 96%
논문 -
Turing NLR v5 XXL 5.4B (fine-tuned)
Matched: 92.6Mismatched: 92.4
- -
ALBERT
Accuracy: 99.2%
논문 코드
T5-3B (explanation prompting)
A1: 81.8A2: 72.5A3: 74.8
논문 -
Turing NLR v5 XXL 5.4B (fine-tuned)
Accuracy: 95.9
- -
Human Benchmark
MCC: 0.626
논문 코드
RCB
Human Benchmark
Average F1: 0.68Accuracy: 0.702
논문 코드
Human Benchmark
Accuracy: 0.92
논문 코드
PaLM 540B (finetuned)
F1: 100Accuracy: 100
논문 코드
CA-MTL
Accuracy: 96.8
논문 코드
mBERT
% Test Accuracy: 83.38
논문 코드

데이터셋

52개

논문

라이브러리

Papers with Code 리더보드 row에 연결된 구현 저장소입니다.

하위 태스크