Reading Comprehension as Natural Language Inference: A Semantic Analysis
원문 초록
In the recent past, Natural language Inference (NLI) has gained significant attention, particularly given its promise for downstream NLP tasks. However, its true impact is limited and has not been well studied. Therefore, in this paper, we explore the utility of NLI for one of the most prominent downstream tasks, viz. Question Answering (QA). We transform the one of the largest available MRC dataset (RACE) to an NLI form, and compare the performances of a state-of-the-art model (RoBERTa) on both these forms. We propose new characterizations of questions, and evaluate the performance of QA and NLI models on these categories. We highlight clear categories for which the model is able to perform better when the data is presented in a coherent entailment form, and a structured question-answer concatenation form, respectively.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
LogiQA 2.0—An Improved Dataset for Logical Reasoning in Natural Language Understanding
Dynamic Chunking and Selection for Reading Comprehension of Ultra-Long Context in Large Language Models
Drop Dropout on Single-Epoch Language Model Pretraining
ExpertLongBench: Benchmarking Language Models on Expert-Level Long-Form Generation Tasks with Structured Checklists
LaMP-QA: A Benchmark for Personalized Long-form Question Answering
Reinforcement Learning for Better Verbalized Confidence in Long-Form Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.