데이터셋 탐색

FEVER is a publicly available dataset for fact extraction and verification against textual sources. It consists of 185,445 claims manually verified against the introductory sections of Wikipedia pages and classified as SUPPORTED, REFUTED or NOTENOUGHINFO. For the first two classes, systems and annotators need to also return the combination of sentences forming the necessary evidence supporting or refuting the claim. The claims were generated by human annotators extracting claims from Wikipedia and mutating them in a variety of ways, some of which were meaning-altering. The verification of each claim was conducted in a separate annotation process by annotators who were aware of the page but not the sentence from which original claim was extracted and thus in 31.75% of the claims more than one sentence was considered appropriate evidence. Claims require composition of evidence from multiple sentences in 16.82% of cases. Furthermore, in 12.15% of the claims, this evidence was taken from multiple pages. Source: FEVER: a large-scale dataset for Fact Extraction and VERification

FEVEROUS (Fact Extraction and VERification Over Unstructured and Structured information) is a fact verification dataset which consists of 87,026 verified claims. Each claim is annotated with evidence in the form of sentences and/or cells from tables in Wikipedia, as well as a label indicating whether this evidence supports, refutes, or does not provide enough information to reach a verdict.

A new publicly available dataset for verification of climate change-related claims. Source: CLIMATE-FEVER: A Dataset for Verification of Real-World Climate Claims

We present a dataset, DANFEVER, intended for claim verification in Danish. The dataset builds upon the task framing of the FEVER fact extraction and verification challenge. DANFEVER can be used for creating models for detecting mis- & disinformation in Danish as well as for verification in multilingual settings.

• CFEVER is a Chinese Fact Extraction and VERification dataset published at AAAI 2024. - CFEVER comprises 30,012 manually created claims based on content in Chinese Wikipedia. - Inspired by the FEVER dataset (Thorne et al., 2018), we provide class labels (Supports, Refutes, or Not Enough Information) and evidence for each claim in the CFEVER dataset. - Download the dataset: https://github.com/IKMLab/CFEVER-data

https://github.com/lingo-iitgn/XME

Poly-FEVER is a multilingual fact verification benchmark designed to evaluate hallucination detection in large language models (LLMs). It extends three widely used fact-checking datasets—FEVER, Climate-FEVER, and SciFact—by translating claims into 11 languages, enabling cross-linguistic analysis of LLM performance. Poly-FEVER consists of 77,973 factual claims with binary labels (SUPPORTS or REFUTES), making it suitable for benchmarking multilingual hallucination detection. The dataset covers various domains, including Arts, Science, Politics, and History. Funded by [optional]: Google Cloud Translation Language(s) (NLP): English(en), Mandarin Chinese (zh-CN), Hindi (hi), Arabic (ar), Bengali (bn), Japanese (ja), Korean (ko), Tamil (ta), Thai (th), Georgian (ka), and Amharic (am)