Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 2편

Human Rights Archive Database

HRA
HRA 설명 보기

A verified-by-experts repository of 3050 human rights violations photographs, labelled with human rights semantic categories, comprising a list of the types of human rights abuses encountered at present. Source: Exploring object-centric and scene-centric CNN features and their complementarity for human rights violations recognition in images

관련 논문 786편

Microsoft Research Paraphrase Corpus

MRPC
MRPC 설명 보기

Microsoft Research Paraphrase Corpus (MRPC) is a corpus consists of 5,801 sentence pairs collected from newswire articles. Each pair is labelled if it is a paraphrase or not by human annotators. The whole set is divided into a training subset (4,076 sentence pairs of which 2,753 are paraphrases) and a test subset (1,725 pairs of which 1,147 are paraphrases). Source: Exploiting Semantic Annotations and Q-Learning for Constructing an Efficient Hierarchy/Graph Texts Organization Image Source: https://www.aclweb.org/anthology/I05-5002.pdf

관련 논문 159편

Paraphrase Adversaries from Word Scrambling

PAWS
PAWS 설명 보기

Paraphrase Adversaries from Word Scrambling (PAWS) is a dataset contains 108,463 human-labeled and 656k noisily labeled pairs that feature the importance of modeling structure, context, and word order information for the problem of paraphrase identification. The dataset has two subsets, one based on Wikipedia and the other one based on the Quora Question Pairs (QQP) dataset. Source: PAWS

관련 논문 31편

PhraseCut

PhraseCut 설명 보기

PhraseCut is a dataset consisting of 77,262 images and 345,486 phrase-region pairs. The dataset is collected on top of the Visual Genome dataset and uses the existing annotations to generate a challenging set of referring phrases for which the corresponding regions are manually annotated. Source: PhraseCut: Language-based Image Segmentation in the Wild Image Source: https://people.cs.umass.edu/~chenyun/publication/phrasecut/

관련 논문 14편

SynthRAD2023

SynthRAD2023 설명 보기

Purpose Medical imaging has become increasingly important in diagnosing and treating oncological patients, particularly in radiotherapy. Recent advances in synthetic computed tomography (sCT) generation have increased interest in public challenges to provide data and evaluation metrics for comparing different approaches openly. This paper describes a dataset of brain and pelvis computed tomography (CT) images with rigidly registered cone-beam CT (CBCT) and magnetic resonance imaging (MRI) images to facilitate the development and evaluation of sCT generation for radiotherapy planning. Acquisition and Validation Methods The dataset consists of CT, CBCT, and MRI of 540 brains and 540 pelvic radiotherapy patients from three Dutch university medical centers. Subjects' ages ranged from 3 to 93 years, with a mean age of 60. Various scanner models and acquisition settings were used across patients from the three data-providing centers. Details are available in a comma separated value files provided with the datasets. Data Format and Usage Notes The data is available on Zenodo (https://doi.org/10.5281/zenodo.7260704, https://doi.org/10.5281/zenodo.7868168) under the SynthRAD2023 collection. The images for each subject are available in nifti format. Potential Applications This dataset will enable the evaluation and development of image synthesis algorithms for radiotherapy purposes on a realistic multi-center dataset with varying acquisition protocols. Synthetic CT generation has numerous applications in radiation therapy, including diagnosis, treatment planning, treatment monitoring, and surgical planning.

관련 논문 4편

Finnish Paraphrase Corpus

Finnish Paraphrase Corpus 설명 보기

Finnish Paraphrase Corpus is a fully manually annotated paraphrase corpus for Finnish containing 53,572 paraphrase pairs harvested from alternative subtitles and news headings. Out of all paraphrase pairs in the corpus 98% are manually classified to be paraphrases at least in their given context, if not in all contexts.

관련 논문 2편

ASHRAE energy prediction III

ASHRAE energy prediction III 설명 보기

Assessing the value of energy efficiency improvements can be challenging as there's no way to truly know how much energy a building would have used without the improvements. The best we can do is to build counterfactual models. Once a building is overhauled the new (lower) energy consumption is compared against modeled values for the original building to calculate the savings from the retrofit. More accurate models could support better market incentives and enable lower-cost financing.

관련 논문 2편

Polish Paraphrase Corpus

PPC
PPC 설명 보기

The Polish Paraphrase Corpus (PPC) is a dataset consisting of 7000 manually labeled sentence pairs in Polish. The purpose of creating this dataset was to verify how machine learning models perform in the challenging problem of paraphrase identification, where most records contain semantically overlapping parts. The dataset was divided into training, validation, and test splits, and each record was assigned to one of three categories: exact paraphrases, close paraphrases, or non-paraphrases. The corpus was created by automatically generating candidate pairs and then manually labeling them. The extracted sentence pairs were drawn from different data sources, including Taboeba, Polish news articles, Wikipedia, and the Polish version of the SICK dataset.

관련 논문 2편

Paraphrased Math Word Problem Solving Repository

ParaMAWPS
ParaMAWPS 설명 보기

This repository contains the code, data, and models of the paper titled "Math Word Problem Solving by Generating Linguistic Variants of Problem Statements" published in the Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop). The work is outlined in a more detailed and expository manner in our Bachelor of Science (B.Sc.) thesis titled "Variational Mathematical Reasoning: Enhancing Math Word Problem Solvers with Linguistic Variants and Disentangled Attention" which can be accessed from the Islamic University of Technology (IUT) Institutional Repository. arXiv anthology GoogleScholar ResearchGate HuggingFace PDF Slides Video Poster Thesis License: Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International license ## Dataset In order to download our dataset PᴀʀᴀMAWPS, please navigate to the ParaMAWPS folder. We use an $80:10:10$ train-validation-test split for our PᴀʀᴀMAWPS dataset. The splits are available in .json format in the aforementioned folder. ### Data Format Each row consists of a Math Word Problem (MWP). The table below describes what each column signifies. Column Title | Description ------------ | ------------- id | The unique identification number of the sample. Seed problems have id size of $\leq 4$, whereas, variant problems have id size of $> 4$. The last variant of a seed problem (generally with the id "$16000i$", where $i$ is the id of the seed problem) is the inverse variant of the seed problem. original_text | The problem statement of the MWP. The seed problems have the same problem statement as present in the Mᴀᴡᴘs dataset. equation | The equation with a variable \(x\) which solves the MWP quantity_tagged_text | The problem statement of the MWP, where each quantity is replaced with a unique tag \([Q_i]\) quantity_tagged_equation | The equation with a variable \(x\) which solves the MWP, but each quantity is replaced with its unique tag \([Q_i]\) in the problem statement have_constant | Whether the use of a constant value is required to solve the MWP <br> For an MWP sample \(i\) with have_constant label \(C_i\), the boolean label is,<br>$C_i =\begin{cases} \text{FALSE}, & \text{if $i$ requires $0$ constant values}\\\ \text{TRUE}, & \text{if $i$ requires $\geq 1$ constant values}\end{cases}$ ## Types of Variations <img src="https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_variationtypes.png" alt="drawing" style="width:1000px;"/> ## Dataset Statistics <img src="https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_datasetcomparisontable.png" alt="drawing" style="width:500px;"/> <img src="https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_datasetcomparisongraph.png" alt="drawing" style="width:500px;"/> # Methodology <img src="https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_architecture2.png" alt="drawing" style="width:1000px;"/> # Results To reproduce the results, please refer to the documentation of MWPToolkit created by Yihuai Lan et al. <img src="https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_results.png" alt="drawing" style="width:500px;"/> <img src="https://github.com/Starscream-11813/Variational-Mathematical-Reasoning/raw/main/images/ACLMWP_ablation.png" alt="drawing" style="width:500px;"/> ## Citation If you find this work useful, please cite our paper: bib @inproceedings{raiyan-etal-2023-math, title = "Math Word Problem Solving by Generating Linguistic Variants of Problem Statements", author = "Raiyan, Syed Rifat and Faiyaz, Md Nafis and Kabir, Shah Md. Jawad and Kabir, Mohsinul and Mahmud, Hasan and Hasan, Md Kamrul", booktitle = "Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 4: Student Research Workshop)", month = jul, year = "2023", address = "Toronto, Canada", publisher = "Association for Computational Linguistics", url = "https://aclanthology.org/2023.acl-srw.49", doi = "10.18653/v1/2023.acl-srw.49", pages = "362--378", abstract = "The art of mathematical reasoning stands as a fundamental pillar of intellectual progress and is a central catalyst in cultivating human ingenuity. Researchers have recently published a plethora of works centered around the task of solving Math Word Problems (MWP) {---} a crucial stride towards general AI. These existing models are susceptible to dependency on shallow heuristics and spurious correlations to derive the solution expressions. In order to ameliorate this issue, in this paper, we propose a framework for MWP solvers based on the generation of linguistic variants of the problem text. The approach involves solving each of the variant problems and electing the predicted expression with the majority of the votes. We use DeBERTa (Decoding-enhanced BERT with disentangled attention) as the encoder to leverage its rich textual representations and enhanced mask decoder to construct the solution expressions. Furthermore, we introduce a challenging dataset, ParaMAWPS, consisting of paraphrased, adversarial, and inverse variants of selectively sampled MWPs from the benchmark Mawps dataset. We extensively experiment on this dataset along with other benchmark datasets using some baseline MWP solver models. We show that training on linguistic variants of problem statements and voting on candidate predictions improve the mathematical reasoning and robustness of the model. We make our code and data publicly available.", } You can also cite our thesis: bib @phdthesis{raiyan2023variational, type={Bachelor's Thesis}, title={Variational Mathematical Reasoning: Enhancing Math Word Problem Solvers with Linguistic Variants and Disentangled Attention}, author={Raiyan, Syed Rifat and Faiyaz, Md Nafis and Kabir, Shah Md Jawad}, year={2023}, school={Department of Computer Science and Engineering (CSE), Islamic University of Technology}, address={Board Bazar, Gazipur-1704, Dhaka, Bangladesh}, note={Available at \url{http://103.82.172.44:8080/xmlui/handle/123456789/2092}} }

관련 논문 1편

Adversarial Paraphrase

AP
AP 설명 보기

This is a paraphrasing dataset created using the adversarial paradigm. A task was designed called the Adversarial Paraphrasing Task (APT) whose objective was to write sentences that mean the same as a given sentence but have as different syntactical and lexical properties as possible. As shown in the paper, this dataset can be used to measure the performance of paraphrase identifier models and train them. This dataset and the task associated with it (APT) can also be used to challenge neural networks to generate better adversarial paraphrases (the work has done this for T5-base), which will in turn help create better paraphrase identifiers.

관련 논문 1편

Autoencoder Paraphrase Dataset (AEPD)

Autoencoder Paraphrase Dataset (AEPD) 설명 보기

This is a benchmark for neural paraphrase detection, to differentiate between original and machine-generated content. ####Training: 1,474,230 aligned paragraphs (98,282 original, 1,375,948 paraphrased with 3 models and 5 hyperparameter configurations each 98,282) extracted from 4,012 (English) Wikipedia articles. ####Testing: BERT-large (cased): arXiv - Original - 20,966; Paraphrased - 20,966; Theses - Original - 5,226; Paraphrased - 5,226; Wikipedia - Original - 39,241; Paraphrased - 39,241; RoBERTa-large (cased): arXiv - Original - 20,966; Paraphrased - 20,966; Theses - Original - 5,226; Paraphrased - 5,226; Wikipedia - Original - 39,241; Paraphrased - 39,241; Longformer-large (uncased): arXiv - Original - 20,966; Paraphrased - 20,966; Theses - Original - 5,226; Paraphrased - 5,226; Wikipedia - Original - 39,241; Paraphrased - 39,241;

관련 논문 1편

Basic Emotion Random phrase Shouts

BERSt
BERSt 설명 보기

BERSt Dataset We release the BERSt Dataset for various speech recognition tasks including Automatic Speech Recognition (ASR) and Speech Emotion Recogniton (SER) Overview 4526 single phrase recordings (~3.75h) 98 professional actors 19 phone positions 7 emotion classes 3 vocal intensity levels varied regional and non-native English accents nonsense phrases covering all English Phonemes Data collection The BERSt dataset represents data collected in home envrionments using various smartphone microphones (phone model available as metadata) Participants were around the globe and represent varying regional accents in English: UK, Canada, USA (multi-state), Australia, including a subset of the data that is non-native English speakers including: French, Russian, Hindi etc. The data includes 13 non-sense phrases for use cases robust to lingustic context and high surprisal. Partipants were prompted to speak, raise their voice and shout each phrase while moving their phone to various distances and locations in their home, as well as with various obstructions to the microphone, e.g. in a backpack Baseline results of various state-of-the-art methods for ASR and SER show that this dataset remains a challenging task, and we encourage researchers to use this data to fine-tune and benchmark their models in these difficult condition representing possible real world situations Affect annotations are those provided to the actors, they have not been validated through perception The speech annotations, however, has been checked and adjusted to mistakes in the speech. Data splits and organisation For each phone position and phrase, the actors provided a single recording for the three vocal intensity levels, these raw audio files are available Meta-data in csv format corresponds to the files split per utterance with noise and silence before and after speech removed, found inside clean_clips for each data splits We provide a test, train and validation split There is no speaker cross-over between splits, the train and validation sets each contain 10 speakers not seen in the training set Metadata Details actor count 98 Gender counts Woman: 61 Man: 34 Non-Binary: 1 Prefer not to disclose 2 Current daily language counts English: 95 Norwegian: 1 Russian: 1 French: 1 First language counts English: 75 Non English: 23 Spanish: 6 French: 3 Portuguese: 3 Chinese: 2 Norwegian: 1 Mandarin: 1 Tagalog: 1 Italian: 1 Hungarian: 1 Russian: 1 Hindi: 1 Swahili: 1 Croatian: 1 Pre-split Data counts Emotion counts fear: 236 neutral: 234 disgust: 232 joy: 224 anger: 223 surprise: 210 sadness: 201 Distance counts: Near body: 627 1-2m away: 324 Other side of room: 316 Outside of room: 293

관련 논문 1편

Mehrad Aria

COVID-19 Lung CT Scans
COVID-19 Lung CT Scans 설명 보기

This is a large public COVID-19 (SARS-CoV-2) lung CT scan dataset, containing total of 8,439 CT scans which consists of 7,495 positive cases (COVID-19 infection) and 944 negative ones (normal and non-COVID-19). Data is available as 512×512px PNG images and have been collected from real patients in radiology centers of teaching hospitals of Tehran, Iran. The aim of this dataset is to encourage the research and development of effective and innovative methods such as deep CNNs which are able to identify if a person is infected by COVID-19 through the analysis of his/her CT scans. As a baseline for this dataset we used a CNN-based approach inspired by transfer learning which we could achieve an accuracy of 99.61% which is very promising.

관련 논문 1편

Keyphrases CS&Math Russian

Keyphrases CS&Math Russian 설명 보기

Dataset contains CS/Math articles abstracts (in Russian) obtained from two online sources. For each article publication year, journal name, authors, title, keyphrases and abstract are provided. Morozov, D. A., Glazkova, A. V., Tyutyulnikov, M. A., & Iomdin, B. L. (2023). Keyphrase generation for abstracts of the Russian-language scientific articles. NSU Vestnik. Series: Linguistics and Intercultural Communication, 21(1), 54-66.

관련 논문 1편

Machine Prarphrase Corpus (MPC)

Machine Prarphrase Corpus (MPC) 설명 보기

This dataset is used to train and evaluate models for the detection of machine-paraphrased text. The training set consists of 200,767 paragraphs (98,282 original, 102,485 paraphrased) extracted from 8,024 Wikipedia (English) articles (4,012 original, 4,012 paraphrased using the SpinBot API). The test set is divided into 3 subsets: one created from preprints of research papers on arXiv, one from graduation theses, and one from Wikipedia articles. Additionally, different marchine-paraphrasing methods were used. Test sets: SpinBot: arXiv - Original - 20,966; Spun - 20,867 Theses - Original - 5,226; Spun - 3,463 Wikipedia - Original - 39,241; Spun - 40,729 SpinnerChief-4W: arXiv - Original - 20,966; Spun - 21,671 Theses - Original - 2,379; Spun - 2,941 Wikipedia - Original - 39,241; Spun - 39,618 SpinnerChief-2W: arXiv - Original - 20,966; Spun - 21,719 Theses - Original - 2,379; Spun - 2,941 Wikipedia - Original - 39,241; Spun - 39,697

관련 논문 1편

Message Content Rephrasing

Message Content Rephrasing 설명 보기

We introduce a new task of rephrasing for amore natural virtual assistant. Currently, vir-tual assistants work in the paradigm of intent-slot tagging and the slot values are directlypassed as-is to the execution engine. However,this setup fails in some scenarios such as mes-saging when the query given by the user needsto be changed before repeating it or sending itto another user. For example, for queries like‘ask my wife if she can pick up the kids’ or ‘re-mind me to take my pills’, we need to rephrasethe content to ‘can you pick up the kids’ and‘take your pills’. In this paper, we study theproblem of rephrasing with messaging as ause case and release a dataset of 3000 pairs oforiginal query and rephrased query. We showthat BART, a pre-trained transformers-basedmasked language model with auto-regressivedecoding, is a strong baseline for the task, andshow improvements by adding a copy-pointerand copy loss to it. We analyze different trade-offs of BART-based and LSTM-based seq2seqmodels, and propose a distilled LSTM-basedseq2seq as the best practical model.

관련 논문 1편

Paraphrase Questions - decaNLP

PQ-decaNLP
PQ-decaNLP 설명 보기

Multitask learning has led to significant advances in Natural Language Processing, including the decaNLP benchmark where question answering is used to frame 10 natural language understanding tasks in a single model. PQ-decaNLP is a crowd-sourced corpus of paraphrased questions, annotated with paraphrase phenomena. This enables analysis of how transformations such as swapping the class labels and changing the sentence modality lead to a large performance degradation.

관련 논문 1편

Phrase-in-Context

Phrase-in-Context 설명 보기

Phrase in Context is a curated benchmark for phrase understanding and semantic search, consisting of three tasks of increasing difficulty: Phrase Similarity (PS), Phrase Retrieval (PR) and Phrase Sense Disambiguation (PSD). The datasets are annotated by 13 linguistic experts on Upwork and verified by two groups: ~1000 AMT crowdworkers and another set of 5 linguistic experts. PiC benchmark is distributed under CC-BY-NC 4.0.

관련 논문 1편

Thermal Hotspots in Raw Sentinel-2 data

THRawS
THRawS 설명 보기

THRawS is a new dataset of raw Sentinel-2 (S-2) satellite data containing warm temperature hotspots such as wildfires and volcanic eruptions from around the world. The dataset aims to promote the development of energy-efficient pre-processing algorithms and AI models for onboard-satellite applications. A custom methodology was designed to identify events in raw data using corresponding Level-1C (L1C) products and a lightweight coarse coregistration and georeferencing strategy was employed to deal with unprocessed data. The dataset comprises over 100 samples, including wildfire, volcanic eruption, and event-free volcanic areas, to enable warm-events detection and general classification applications. Finally, the performances of the proposed coarse spatial coregistration technique and the SuperGlue Deep Neural Network method were compared to highlight different constraints in terms of timing and quality of spatial registration to minimize spatial displacement error for a specific scene. Github Repo: https://github.com/ESA-PhiLab/PyRawS

관련 논문 1편

Vietnamese Sentence Paraphrases

ViSP
ViSP 설명 보기

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

관련 논문 1편

https://www.kaggle.com/competitions/ashrae-energy-prediction

https://www.kaggle.com/competitions/ashrae-energy-prediction 설명 보기

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

관련 논문 0편

ChatGPT Paraphrases

ChatGPT Paraphrases 설명 보기

This is a dataset of paraphrases created by ChatGPT. We used this prompt to generate paraphrases: Generate 5 similar paraphrases for this question, show it like a numbered list without commentaries: {text} This dataset is based on the Quora paraphrase question, texts from the SQUAD 2.0 and the CNN news dataset. We generated 5 paraphrases for each sample, totally this dataset has about 350k data rows. You can make 30 rows from a row from each sample. In this way you can make 10.5 millions train pairs (350k rows with 5 paraphrases -> 6x5x350000 = 10.5 millions of bidirected or 6x5x350000/2 = 5.25 millions of unique pairs). We used: - 231927 questions from the Quora dataset - 92005 texts from the Squad 2.0 dataset - 29110 texts from the CNN news dataset Structure of the dataset: - text column - an original sentence or question from the datasets - paraphrases - a list of 5 paraphrases - category - question / sentence - source - quora / squad_2 / cnn_news

관련 논문 0편

Paraphrase and Semantic Similarity in Twitter

SemEval-2015 Task-1
SemEval-2015 Task-1 설명 보기

Given two sentences, the participants are asked to determine whether they express the same or very similar meaning and optionally a degree score between 0 and 1. Following the literature on paraphrase identification, we evaluate system performance primarily by the F-1 score and Accuracy against human judgments. We also provide additional evaluations by Pearson correlation and PINC (Chen and Dolan, 2011), which measure lexical dissimilarity between sentence pairs.