https://github.com/neukg/robustmrc
공식 코드An Understanding-Oriented Robust Machine Reading Comprehension Model
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Natural language inference (NLI) is the task of determining whether a "hypothesis" is true (entailment), false (contradiction), or undetermined (neutral) given a "premise".
Example:
| Premise | Label | Hypothesis |
|---|---|---|
| A man inspects the uniform of a figure in some East Asian country. | contradiction | The man is sleeping. |
| An older and younger man smiling. | neutral | Two men are smiling and laughing at the cats playing on the floor. |
| A soccer game with multiple males playing. | entailment | Some men are playing a sport. |
Approaches used for NLI include earlier symbolic and statistical approaches to more recent deep learning approaches. Benchmark datasets used for NLI include SNLI, MultiNLI, SciTail, among others. You can get hands-on practice on the SNLI task by following this d2l.ai chapter.
Further readings:
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
An Understanding-Oriented Robust Machine Reading Comprehension Model
Enhancing Ethical Explanations of Large Language Models through Iterative Symbolic Refinement
Verification and Refinement of Natural Language Explanations through LLM-Symbolic Theorem Proving
AILS-NTUA at SemEval-2024 Task 6: Efficient model tuning for hallucination detection and analysis
uOttawa at LegalLens-2024: Transformer-based Classification Experiments
CASPR: Automated Evaluation Metric for Contrastive Summarization
Investigating Reasons for Disagreement in Natural Language Inference
Lightweight Transformers for Clinical Natural Language Processing
Unsupervised Natural Language Inference Using PHL Triplet Generation
A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets
ZARA: Improving Few-Shot Self-Rationalization for Small Language Models
A Generalized Framework of Sequence Generation with Application to Undirected Sequence Models
Asking Crowdworkers to Write Entailment Examples: The Best of Bad Options
Exploring the Limits of Natural Language Inference Based Setup for Few-Shot Intent Detection
Harnessing the Power of Multi-Task Pretraining for Ground-Truth Level Natural Language Explanations
ANAH-v2: Scaling Analytical Hallucination Annotation of Large Language Models
From Alignment to Entailment: A Unified Textual Entailment Framework for Entity Alignment
Making Retrieval-Augmented Language Models Robust to Irrelevant Context
Label Verbalization and Entailment for Effective Zero- and Few-Shot Relation Extraction
Automatic Evaluation of Attribution by Large Language Models
The Curse of Performance Instability in Analysis Datasets: Consequences, Source, and Suggestions
Towards Robustifying NLI Models Against Lexical Dataset Biases
A Hybrid Approach to Information Retrieval and Answer Generation for Regulatory Texts
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.