Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 1,404편

Natural Questions

Natural Questions 설명 보기

The Natural Questions corpus is a question answering dataset containing 307,373 training examples, 7,830 development examples, and 7,842 test examples. Each example is comprised of a google.com query and a corresponding Wikipedia page. Each Wikipedia page has a passage (or long answer) annotated on the page that answers the question and one or more short spans from the annotated passage containing the actual answer. The long and the short answer annotations can however be empty. If they are both empty, then there is no answer on the page at all. If the long answer annotation is non-empty, but the short answer annotation is empty, then the annotated passage answers the question but no explicit short answer could be found. Finally 1% of the documents have a passage annotated with a short answer that is “yes” or “no”, instead of a list of short spans. Source: A BERT Baseline for the Natural Questions Image Source: https://paperswithcode.com/paper/natural-questions-a-benchmark-for-question/

관련 논문 701편

Boolean Questions

BoolQ
BoolQ 설명 보기

BoolQ is a question answering dataset for yes/no questions containing 15942 examples. These questions are naturally occurring – they are generated in unprompted and unconstrained settings. Each example is a triplet of (question, passage, answer), with the title of the page as optional additional context. Questions are gathered from anonymized, aggregated queries to the Google search engine. Queries that are likely to be yes/no questions are heuristically identified and questions are only kept if a Wikipedia page is returned as one of the first five results, in which case the question and Wikipedia page are given to a human annotator for further processing. Annotators label question/article pairs in a three-step process. First, they decide if the question is good, meaning it is comprehensible, unambiguous, and requesting factual information. This judgment is made before the annotator sees the Wikipedia page. Next, for good questions, annotators find a passage within the document that contains enough information to answer the question. Annotators can mark questions as “not answerable” if the Wikipedia article does not contain the requested information. Finally, annotators mark whether the question’s answer is “yes” or “no”. Only questions that were marked as having a yes/no answer are used, and each question is paired with the selected passage instead of the entire document. Source: https://github.com/google-research-datasets/boolean-questions Image Source: BoolQ: Exploring the Surprising Difficulty of Natural Yes/No Questions

관련 논문 241편

WebQuestions

WebQuestions 설명 보기

The WebQuestions dataset is a question answering dataset using Freebase as the knowledge base and contains 6,642 question-answer pairs. It was created by crawling questions through the Google Suggest API, and then obtaining answers using Amazon Mechanical Turk. The original split uses 3,778 examples for training and 2,032 for testing. All answers are defined as Freebase entities. Example questions (answers) in the dataset include “Where did Edgar Allan Poe died?” (baltimore) or “What degrees did Barack Obama get?” (bachelor_of_arts, juris_doctor). Source: Question Answering with Subgraph Embeddings Image Source: Berant et al

관련 논문 120편

SimpleQuestions

SimpleQuestions 설명 보기

SimpleQuestions is a large-scale factoid question answering dataset. It consists of 108,442 natural language questions, each paired with a corresponding fact from Freebase knowledge base. Each fact is a triple (subject, relation, object) and the answer to the question is always the object. The dataset is divided into training, validation, and test sets with 75,910, 10,845 and 21,687 questions respectively. Source: Hierarchical Memory Networks Image Source: https://paperswithcode.com/paper/large-scale-simple-question-answering-with/

관련 논문 79편

WikiTableQuestions

WikiTableQuestions 설명 보기

WikiTableQuestions is a question answering dataset over semi-structured tables. It is comprised of question-answer pairs on HTML tables, and was constructed by selecting data tables from Wikipedia that contained at least 8 rows and 5 columns. Amazon Mechanical Turk workers were then tasked with writing trivia questions about each table. WikiTableQuestions contains 22,033 questions. The questions were not designed by predefined templates but were hand crafted by users, demonstrating high linguistic variance. Compared to previous datasets on knowledge bases it covers nearly 4,000 unique column headers, containing far more relations than closed domain datasets and datasets for querying knowledge bases. Its questions cover a wide range of domains, requiring operations such as table lookup, aggregation, superlatives (argmax, argmin), arithmetic operations, joins and unions. Source: Explaining Queries over Web Tables to Non-Experts Image Source: https://ppasupat.github.io/WikiTableQuestions/

관련 논문 62편

ComplexWebQuestions

ComplexWebQuestions 설명 보기

ComplexWebQuestions is a dataset for answering complex questions that require reasoning over multiple web snippets. It contains a large set of complex questions in natural language, and can be used in multiple ways: 1. By interacting with a search engine; 2. As a reading comprehension task: the authors release 12,725,989 web snippets that are relevant for the questions, and were collected during the development of their model; 3. As a semantic parsing task: each question is paired with a SPARQL query that can be executed against Freebase to retrieve the answer. Source: Allen Institute for AI Image Source: Talmor et al

관련 논문 61편

WebQuestions Semantic Parses Dataset

WebQuestionsSP
WebQuestionsSP 설명 보기

The WebQuestionsSP dataset is released as part of our ACL-2016 paper “The Value of Semantic Parse Labeling for Knowledge Base Question Answering” [Yih, Richardson, Meek, Chang & Suh, 2016], in which we evaluated the value of gathering semantic parses, vs. answers, for a set of questions that originally comes from WebQuestions [Berant et al., 2013]. The WebQuestionsSP dataset contains full semantic parses in SPARQL queries for 4,737 questions, and “partial” annotations for the remaining 1,073 questions for which a valid parse could not be formulated or where the question itself is bad or needs a descriptive answer. This release also includes an evaluation script and the output of the STAGG semantic parsing system when trained using the full semantic parses. More detail can be found in the document and labeling instructions included in this release, as well as the paper. Source: WebQuestions Semantic Parses Dataset

관련 논문 53편

Probably Asked Questions

PAQ
PAQ 설명 보기

Probably Asked Questions (PAQ) is a very large resource of 65M automatically-generated QA-pairs. PAQ is a semi-structured Knowledge Base (KB) of 65M natural language QA-pairs, which models can memorise and/or learn to retrieve from. PAQ differs from traditional KBs in that questions and answers are stored in natural language, and that questions are generated such that they are likely to appear in ODQA datasets. PAQ is automatically constructed using a question generation model and Wikipedia. Source: Lewis et al. Image source: Lewis et al.

관련 논문 49편

Multilingual Knowledge Questions and Answers

MKQA
MKQA 설명 보기

Multilingual Knowledge Questions and Answers (MKQA) is an open-domain question answering evaluation set comprising 10k question-answer pairs aligned across 26 typologically diverse languages (260k question-answer pairs in total). The goal of this dataset is to provide a challenging benchmark for question answering quality across a wide set of languages. Answers are based on a language-independent data representation, making results comparable across languages and independent of language-specific passages. With 26 languages, this dataset supplies the widest range of languages to-date for evaluating question answering.

관련 논문 25편

Answer Sentence Natural Questions

ASNQ
ASNQ 설명 보기

A large scale dataset to enable the transfer step, exploiting the Natural Questions dataset. Source: TANDA: Transfer and Adapt Pre-Trained Transformer Models for Answer Sentence Selection

관련 논문 23편

TimeQuestions

TimeQuestions 설명 보기

Question answering over knowledge graphs (KG-QA) is a vital topic in IR. Questions with temporal intent are a special class of practical importance, but have not received much attention in research. We present EXAQT, the first end-to-end system for answering complex temporal questions that have multiple entities and predicates, and associated temporal conditions.

관련 논문 17편

ConvQuestions

ConvQuestions 설명 보기

ConvQuestions is the first realistic benchmark for conversational question answering over knowledge graphs. It contains 11,200 conversations which can be evaluated over Wikidata. They are compiled from the inputs of 70 Master crowdworkers on Amazon Mechanical Turk, with conversations from five domains: Books, Movies, Soccer, Music, and TV Series. The questions feature a variety of complex question phenomena like comparisons, aggregations, compositionality, and temporal reasoning. Answers are grounded in Wikidata entities to enable fair comparison across diverse methods. The data gathering setup was kept as natural as possible, with the annotators selecting entities of their choice from each of the five domains, and formulating the entire conversation in one session. All questions in a conversation are from the same Turker, who also provided gold answers to the questions. For suitability to knowledge graphs, questions were constrained to be objective or factoid in nature, but no other restrictive guidelines were set. A notable property of ConvQuestions is that several questions are not answerable by Wikidata alone (as of September 2019), but the required facts can, for example, be found in the open Web or in Wikipedia. For details, please refer to our CIKM 2019 full paper.

관련 논문 15편

Fact Verification from Information-seeking Questions

FaVIQ
FaVIQ 설명 보기

FaVIQ (Fact Verification from Information-seeking Questions) is a challenging and realistic fact verification dataset that reflects confusions raised by real users. We use the ambiguity in information-seeking questions and their disambiguation, and automatically convert them to true and false claims. These claims are natural, and require a complete understanding of the evidence for verification. FaVIQ serves as a challenging benchmark for natural language understanding, and improves performance in professional fact checking. Source: https://faviq.github.io

관련 논문 14편

GraphQuestions

GraphQuestions 설명 보기

GraphQuestions is a characteristic-rich dataset designed for factoid question answering. The dataset aims to provide a systematic way of constructing QA datasets with rich and explicitly specified question characteristics. Here are some key details about GraphQuestions: 1. GraphQuestions consists of a set of 5,166 factoid questions. 2. Each question is associated with logical forms and ground-truth answers. 3. The dataset is constructed based on Freebase, a large-scale knowledge base. 4. An array of question characteristics is formalized for each question.

관련 논문 7편

Russian Knowledge Base Questions

RuBQ
RuBQ 설명 보기

The first Russian knowledge base question answering (KBQA) dataset. The high-quality dataset consists of 1,500 Russian questions of varying complexity, their English machine translations, SPARQL queries to Wikidata, reference answers, as well as a Wikidata sample of triples containing entities with Russian labels. The dataset creation started with a large collection of question-answer pairs from online quizzes. The data underwent automatic filtering, crowd-assisted entity linking, automatic generation of SPARQL queries, and their subsequent in-house verification. Source: RuBQ: A Russian Dataset for Question Answering over Wikidata

관련 논문 4편

ARC Direct Answer Questions

ARC-DA
ARC-DA 설명 보기

ARC Direct Answer Questions (ARC-DA) dataset consists of 2,985 grade-school level, direct-answer ("open response", "free form") science questions derived from the ARC multiple-choice question set released as part of the AI2 Reasoning Challenge in 2018. ### How the dataset was built These questions were derived from the ARC multiple-choice question set released as part of the AI2 Reasoning Challenge in 2018. The ARC Easy and ARC Challenge set questions in the original dataset were combined and then filtered/modified by the following process: - Turking: Each of the multiple-choice questions was presented as a direct answer question to five crowdsourced workers to gather additional answers. - Heuristic filtering: The questions were filtered based on the following heuristic filters: - Questions having a threshold number of turker answers, as a proxy for concreteness of the question. - Questions having at least two turker-provided answers with word overlap, as a measure of confidence in the correctness of the answers, and also straightforwardness of the question. - Other heuristics to identify questions that only make sense as multiple-choice questions, such as, questions starting with the phrase “Which of the following”. - Further manual vetting: We had volunteers in house do another pass of vetting where they: - Marked highly open-ended questions with too many answer choices, such as “Name an insect”, or otherwise invalid questions, for removal. These are filtered out. - Removed some of the bad answers gathered from turking. - Reworded questions to make them more suited to direct answer question format, for e.g., a question such as “What element is contained in table salt?” which would make sense as a multiple-choice question, needs be reworded to something like “Name an element present in table salt”. - Added any additional answers to the questions they could think of that were not present in the turker provided answers. Image source: ARC-DA dataset

관련 논문 4편

Discharge Summary Clinical Questions

DiSCQ
DiSCQ 설명 보기

DiSCQ is a newly curated question dataset composed of 2,000+ questions paired with the snippets of text (triggers) that prompted each question. The questions are generated by medical experts from 100+ MIMIC-III discharge summaries. This dataset is released to facilitate further research into realistic clinical Question Answering (QA) and Question Generation (QG). Source: Learning to Ask Like a Physician Image Source: https://arxiv.org/pdf/2206.02696.pdf

관련 논문 3편

Researchy Questions

Researchy Questions 설명 보기

Researchy Questions is a set of about 100k Bing queries that users spent the most effort on. After a labor-intensive filtering funnel from billions of queries, these "needles in the haystack" are non-factoid, multi-perspective questions that require a lot of sub-questions and research to answer adequately. These questions are shown to be harder than other open domain QA datasets like Natural Questions.

관련 논문 2편

Natural Questions In Icelandic

NQiI
NQiI 설명 보기

Natural Questions in Icelandic (NQiI) is a valuable dataset designed for extractive question answering (QA) in the Icelandic language. Let me provide you with some details about this dataset: 1. Purpose and Importance: - The NQiI dataset was created to facilitate the development and evaluation of Icelandic QA systems. - It also supports the development of QA methods that need to work across a wide range of morphologically and grammatically diverse languages in a multilingual context¹. 2. Dataset Creation: - Contributors were asked to come up with questions they were genuinely interested in knowing the answers to. - Later, they were tasked with finding answers to each other's questions using a previously published methodology. - The questions in NQiI are "natural" in the sense that they arise from genuine curiosity¹. 3. Dataset Details: - The complete NQiI dataset contains 18,000 labeled entries. - Among these, 5,568 entries are directly suitable for training an extractive QA system specifically for Icelandic¹. 4. Resource and Evaluation: - NQiI serves as a valuable resource for Icelandic language research. - Researchers have used it to create and evaluate systems capable of extractive QA in Icelandic¹. (1) Natural Questions in Icelandic - ACL Anthology. https://aclanthology.org/2022.lrec-1.477/. (2) NQiI - Natural Questions In Icelandic - v1.0 - CLARIN. https://repository.clarin.is/repository/xmlui/handle/20.500.12537/143. (3) Natural Questions in Icelandic - ACL Anthology. https://aclanthology.org/2022.lrec-1.477/. (4) Natural Questions in Icelandic - ACL Anthology. https://aclanthology.org/2022.lrec-1.477.pdf. (5) undefined. https://aclanthology.org/2022.lrec-1.477.

관련 논문 2편

Recipe-to-Video Questions

R2VQ
R2VQ 설명 보기

R2VQ is a dataset designed for testing competence-based comprehension of machines over a multimodal recipe collection, which contains text-video aligned recipes. A total of 51,331 cooking events are annotated, which contain 19,201 explicit ingredients, 16,338 implicit ingredients, 12,316 explicit props, and 11,868 implicit props.

관련 논문 1편

60k Stack Overflow Questions from 2016-2020 classified into three categories based on their quality

60k Stack Overflow Questions
60k Stack Overflow Questions 설명 보기

The dataset contains 60,000 Stack Overflow questions from 2016-2020, classified into three categories: 1. HQ: High-quality posts without a single edit. 2. LQ_EDIT: Low-quality posts with a negative score, and multiple community edits. However, they still remain open after those changes. 3. LQ_CLOSE: Low-quality posts that were closed by the community without a single edit. ## Notes - Questions are sorted according to Question Id. - Question body is in HTML format. - All dates are in UTC format. - The dataset is also accessible at https://www.kaggle.com/imoore/60k-stack-overflow-questions-with-quality-rate ## How to cite This is an original dataset, published under MIT License. Please cite the dataset for your usage as the following: @article{annamoradnejad2022multiview, title={Multi-View Approach to Suggest Moderation Actions in Community Question Answering Sites}, author={Annamoradnejad, Issa and Habibi, Jafar and Fazli, Mohammadamin}, journal = {Information Sciences}, volume = {600}, pages = {144-154}, year = {2022}, issn = {0020-0255}, doi = {https://doi.org/10.1016/j.ins.2022.03.085}, url = {https://www.sciencedirect.com/science/article/pii/S0020025522003127} }

관련 논문 1편

Advice Seeking Questions

Advice Seeking Questions 설명 보기

The Advice-Seeking Questions (ASQ) dataset is a collection of personal narratives with advice-seeking questions. The dataset has been split into train, test, heldout sets, with 8865, 2500, 10000 test instances each. This dataset is used to train and evaluate methods that can infer what is the advice-seeking goal behind a personal narrative. This task is formulated as a cloze test, where the goal is to identify which of two advice-seeking questions was removed from a given narrative. Source: https://github.com/CornellNLP/ASQ

관련 논문 1편

Doctor-patient questions (French)

Doctor-patient questions (French) 설명 보기

These are the test and training data used for experiments presented in BioNLP 2017. ## Licence The data are only aimed for research, educational and non-commercial purposes. ## How to cite If you use these data, please cite our contribution to BioNLP 2017 as follows: Automatic classification of doctor-patient questions for a virtual patient record query task Leonardo Campillos-Llanos, Sophie Rosset, Pierre Zweigenbaum Proc. of BioNLP 2017, August 4 2017, Vancouver, Canada, pp. 333-341 Note that these data were manually collected from books aimed at medical consultation and clinical examination, as well as resources for medical translation. These sources also need to be referenced as follows: * Barbara Bates and Lynn S Bickley. 2014. Guide de l’examen clinique-Nouvelle édition 2014. Arnette- John Libbey Eurotext. * Claire Coudé, Franois-Xavier Coudé, and Kai Kassmann. 2011. Guide de conversation médicale - français-anglais-allemand. Lavoisier, Médecine Sciences Publications. * Owen Epstein, David Perkin, John Cookson, and David P. de Bono. 2015. Guide pratique de l’examen clinique. Elsevier Masson, Paris. * Félicie Pastore. 2015. How can I help you today? Guide de la consultation médicale et paramédicale en anglais. Ellipses, Paris. * UMVF/Medical English Portal UFR Médecine de Dijon (Last access: May 2017)

관련 논문 1편

Forbidden_Questions_160

Forbidden_Questions_160 설명 보기

Here is the forbidden question dataset (based on two previous works), it contains 160 questions from 160 violated categories. In addition, authors also provide the corresponding target -- which is useful for some jailbreak methods, such as GCG.

관련 논문 1편

Forbidden Question Dataset (160)

Forbidden_Questions_CJA
Forbidden_Questions_CJA 설명 보기

Here is the forbidden question dataset (based on two previous works), it contains 160 questions from 160 violated categories. In addition, authors also provide the corresponding target -- which is useful for some jailbreak methods, such as GCG.

관련 논문 1편

GeoQuestions1089

GeoQuestions1089 설명 보기

GeoQuestions1089 is a crowdsourced geospatial question-answering dataset that targets the Knowledge Graph YAGO2geo. It contains 1089 triples of geospatial questions, their answers, and the respective SPARQL/GeoSPARQL queries. It has been used to benchmark two state of the art Question Answering engines, GeoQA2 and the engine of Hamzei et al.

관련 논문 1편

Paraphrase Questions - decaNLP

PQ-decaNLP
PQ-decaNLP 설명 보기

Multitask learning has led to significant advances in Natural Language Processing, including the decaNLP benchmark where question answering is used to frame 10 natural language understanding tasks in a single model. PQ-decaNLP is a crowd-sourced corpus of paraphrased questions, annotated with paraphrase phenomena. This enables analysis of how transformations such as swapping the class labels and changing the sentence modality lead to a large performance degradation.

관련 논문 1편

Usage-related Questions

Usage-related Questions 설명 보기

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

관련 논문 0편

Contact Expedia for Trip Cancellation Questions

[100% Guidelines] Contact Expedia for Trip Cancellation Questions
[100% Guidelines] Contact Expedia for Trip Cancellation Questions 설명 보기

☎️ +1(888) 714-9824 is the number to call when you have trip cancellation questions through Expedia. Whether your cancellation involves a flight, hotel, rental car, or vacation package, calling ☎️ +1(888) 714-9824 connects you directly with agents who can explain refund policies, guide you through next steps, and check for possible credits. Not every booking comes with the same cancellation terms, so dialing ☎️ +1(888) 714-9824 ensures you’re getting real-time, personalized information rather than relying on guesswork or generic website pages. Canceling a trip through Expedia may seem easy at first, but once you realize each airline, hotel, or travel partner has its own policy, things get complicated. That’s where ☎️ +1(888) 714-9824 becomes crucial. If you’re dealing with non-refundable tickets, partial refunds, or supplier-initiated cancellations, the support staff at ☎️ +1(888) 714-9824 will help determine what portion of your trip qualifies for a refund or credit. They’ll also assist with necessary documentation in case you need to file a claim through travel insurance or Expedia’s protection plans. In addition to canceling trips, ☎️ +1(888) 714-9824 is the best way to get questions answered about rebooking options. For example, you might be eligible to change your itinerary instead of losing your payment entirely. The team at ☎️ +1(888) 714-9824 can explain your options clearly, including any rebooking deadlines, fees, or route adjustments. If your cancellation is due to emergencies or airline disruptions, Expedia may even waive certain penalties—but only if you call ☎️ +1(888) 714-9824 and report the issue promptly. Trip cancellations can be stressful, especially when you're trying to avoid losing money or missing a deadline. That’s why ☎️ +1(888) 714-9824 is a vital lifeline. Whether you’re canceling one part of a trip or the entire itinerary, Expedia agents at ☎️ +1(888) 714-9824 provide support that’s fast, reliable, and personalized to your unique booking situation. Save this number—it’s your first step toward resolving cancellations quickly and fairly. 2. Can I Call Expedia Customer Service Directly? ☎️ +1(888) 714-9824 is the direct number to reach Expedia customer service whenever you need real-time help with any travel-related question. You don’t need to wait for chatbots, email replies, or long wait times when you dial ☎️ +1(888) 714-9824, because Expedia’s trained representatives will take your call and assist with bookings, cancellations, account issues, or technical problems. Whether you’re traveling now or planning a trip for next year, ☎️ +1(888) 714-9824 is your all-in-one number for customer support. Yes, you absolutely can call Expedia directly—and in fact, it’s often the most efficient way to get clear answers. Not everything can be solved online, especially when dealing with complicated itineraries, non-refundable fares, or international bookings. That’s why ☎️ +1(888) 714-9824 is such a valuable resource. The agents at ☎️ +1(888) 714-9824 have access to internal systems and communication tools to coordinate with airlines, hotels, and rental car providers. When you call ☎️ +1(888) 714-9824, you’re not just getting customer service—you’re getting advocacy. Expedia agents work on your behalf to resolve disputes, clarify policies, and find alternative solutions when plans go awry. If you’re at the airport, stuck at a hotel, or unable to access your booking, calling ☎️ +1(888) 714-9824 connects you to someone who can fix the issue right away. This makes all the difference when time is critical and the stakes are high. Even if your question seems small—like checking a confirmation number, updating contact info, or linking rewards—☎️ +1(888) 714-9824 is still the best number to use. The Expedia team offers 24/7 support for travelers across the globe. No matter the time zone, day of the week, or urgency of your concern, ☎️ +1(888) 714-9824 is your direct access to answers. Save this number now—it may be the most helpful contact in your travel arsenal.