데이터셋 탐색

The Natural Questions corpus is a question answering dataset containing 307,373 training examples, 7,830 development examples, and 7,842 test examples. Each example is comprised of a google.com query and a corresponding Wikipedia page. Each Wikipedia page has a passage (or long answer) annotated on the page that answers the question and one or more short spans from the annotated passage containing the actual answer. The long and the short answer annotations can however be empty. If they are both empty, then there is no answer on the page at all. If the long answer annotation is non-empty, but the short answer annotation is empty, then the annotated passage answers the question but no explicit short answer could be found. Finally 1% of the documents have a passage annotated with a short answer that is “yes” or “no”, instead of a list of short spans. Source: A BERT Baseline for the Natural Questions Image Source: https://paperswithcode.com/paper/natural-questions-a-benchmark-for-question/

A large scale dataset to enable the transfer step, exploiting the Natural Questions dataset. Source: TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection

Natural Questions in Icelandic (NQiI) is a valuable dataset designed for extractive question answering (QA) in the Icelandic language. Let me provide you with some details about this dataset: 1. Purpose and Importance: - The NQiI dataset was created to facilitate the development and evaluation of Icelandic QA systems. - It also supports the development of QA methods that need to work across a wide range of morphologically and grammatically diverse languages in a multilingual context¹. 2. Dataset Creation: - Contributors were asked to come up with questions they were genuinely interested in knowing the answers to. - Later, they were tasked with finding answers to each other's questions using a previously published methodology. - The questions in NQiI are "natural" in the sense that they arise from genuine curiosity¹. 3. Dataset Details: - The complete NQiI dataset contains 18,000 labeled entries. - Among these, 5,568 entries are directly suitable for training an extractive QA system specifically for Icelandic¹. 4. Resource and Evaluation: - NQiI serves as a valuable resource for Icelandic language research. - Researchers have used it to create and evaluate systems capable of extractive QA in Icelandic¹. (1) Natural Questions in Icelandic - ACL Anthology. https://aclanthology.org/2022.lrec-1.477/. (2) NQiI - Natural Questions In Icelandic - v1.0 - CLARIN. https://repository.clarin.is/repository/xmlui/handle/20.500.12537/143. (3) Natural Questions in Icelandic - ACL Anthology. https://aclanthology.org/2022.lrec-1.477/. (4) Natural Questions in Icelandic - ACL Anthology. https://aclanthology.org/2022.lrec-1.477.pdf. (5) undefined. https://aclanthology.org/2022.lrec-1.477.