Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 151편

Stanford Question Answering Dataset

SQuAD
SQuAD 설명 보기

The Stanford Question Answering Dataset (SQuAD) is a collection of question-answer pairs derived from Wikipedia articles. In SQuAD, the correct answers of questions can be any sequence of tokens in the given text. Because the questions and answers are produced by humans through crowdsourcing, it is more diverse than some other question-answering datasets. SQuAD 1.1 contains 107,785 question-answer pairs on 536 articles. SQuAD2.0 (open-domain SQuAD, SQuAD-Open), the latest version, combines the 100,000 questions in SQuAD1.1 with over 50,000 un-answerable questions written adversarially by crowdworkers in forms that are similar to the answerable ones. Source: Deep Learning Based Text Classification: A Comprehensive Review Image Source: https://rajpurkar.github.io/SQuAD-explorer/explore/v2.0/dev/Prime_number.html

관련 논문 24편

Spoken-SQuAD

Spoken-SQuAD 설명 보기

In SpokenSQuAD, the document is in spoken form, the input question is in the form of text and the answer to each question is always a span in the document. The following procedures were used to generate spoken documents from the original SQuAD dataset. First, the Google text-to-speech system was used to generate the spoken version of the articles in SQuAD. Then CMU Sphinx was sued to generate the corresponding ASR transcriptions. The SQuAD training set was used to generate the training set of Spoken SQuAD, and SQuAD development set was used to generate the testing set for Spoken SQuAD. If the answer of a question did not exist in the ASR transcriptions of the associated article, the question-answer pair was removed from the dataset because these examples are too difficult for listening comprehension machine at this stage. Source: https://github.com/chiahsuan156/Spoken-SQuAD Image Source: https://github.com/chiahsuan156/Spoken-SQuAD

관련 논문 9편

SQuADShifts

SQuADShifts 설명 보기

Provides four new test sets for the Stanford Question Answering Dataset (SQuAD) and evaluate the ability of question-answering systems to generalize to new data. Source: The Effect of Natural Distribution Shift on Question Answering Models

관련 논문 1편

SQuAD-it

SQuAD-it 설명 보기

SQuAD-it is derived from the SQuAD dataset and it is obtained through semi-automatic translation of the SQuAD dataset into Italian. It represents a large-scale dataset for open question answering processes on factoid questions in Italian. The dataset contains more than 60,000 question/answer pairs derived from the original English dataset. Source: SQuAD-it

관련 논문 1편

SQuAD-sr

SQuAD-sr 설명 보기

Synthetic Question Answering dataset in Serbian, acquired by automatic translation of SQuAD.

관련 논문 1편

SchizzoSQUAD

SchizzoSQUAD 설명 보기

The “Mental Health” forum was used, a forum dedicated to people suffering from schizophrenia and different mental disorders. Relevant posts of active users, who regularly participate, were extrapolated providing a new method of obtaining low-bias content and without privacy issues. This corpus i then processed to offer a SQUAD (Standford Question Answering Dataset) version in order to train a ML QA model. The structure is a Json with different keys with the following structure: { "data": [ { "paragraphs": [ { "qas": [ { "question": "What is the patient afraid of?", "id": 304425, "answers": [ { "answer_id": 305544, "document_id": 501182, "question_id": 304425, "text": "I’m afraid of people except for my family and a few close friends", "answer_start": 29769, "answer_category": null } ], "is_impossible": false } ], "context": "\t" I don’t understand why people send aid to other countries and go on missions when our own country people are suffering and have nothing, in the us at least."\n\t"7-21-19 Said \"What is she afraid of? Afraid of family!?, "document_id": 501182 } ] }

관련 논문 0편

ChineseSquad

ChineseSquad 설명 보기

ChineseSquad (中文机器阅读理解数据集) is a dataset specifically designed for Chinese machine reading comprehension. It is created by translating and manually correcting the original SQuAD (Stanford Question Answering Dataset) into Chinese. The dataset includes both V1.1 and V2.0 versions of SQuAD. However, due to some translation challenges (especially with short answers and document translations), the Chinese version has slightly fewer examples compared to the original English SQuAD¹. Here are some key details about the ChineseSquad dataset: - Data Sources: - ChineseSquad is derived from the original SQuAD dataset through machine translation and subsequent manual corrections. - It includes both the V1.1 and V2.0 versions. - Data Size: - The dataset contains both questions with answers and questions without answers. - Here's a breakdown of the data: - squad-zen 1.0 train: 68,213 examples with answers, 43,498 examples without answers (total: 110k) - squad-zen 1.0 dev: 8,326 examples with answers, 5,954 examples without answers (total: 14k) - squad 2.0 train: 46,530 examples with answers, 43,498 examples without answers (total: 90k) - squad 2.0 dev: 3,391 examples with answers, 5,945 examples without answers (total: 9k) - squad 1.1 dev: 7,679 examples (no answers provided) - squad 1.1 train: 55,526 examples (no answers provided)