Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 38편

RGBT234

RGBT234 설명 보기

The RGBT234 dataset is a comprehensive video dataset specifically designed for RGB-T (Red-Green-Blue and Thermal) tracking purposes. This dataset addresses the limitations of existing datasets like OSU-CT, LITIV, and GTOT in terms of size. RGBT234 consists of 234 RGB-T videos, each containing both an RGB video and a thermal video. The total number of frames in the dataset is approximately 234,000, with the largest video pair containing up to 8,000 frames.Each frame in the RGBT234 dataset is annotated with a minimum bounding box that covers the target for both the RGB and thermal modalities. The dataset also includes various environmental challenges such as rainy conditions, nighttime scenes, cold and hot weather scenarios. To analyze the performance of different tracking algorithms based on specific attributes, the RGBT234 dataset annotates 12 attributes and provides baseline trackers, including both deep learning and non-deep learning methods like structured SVM, sparse representation, and correlation filter-based trackers. Additionally, the dataset employs 5 metrics to evaluate the performance of RGB-T trackers effectively.

관련 논문 38편

SUN Attribute

SUN Attribute 설명 보기

The SUN Attribute dataset consists of 14,340 images from 717 scene categories, and each category is annotated with a taxonomy of 102 discriminate attributes. The dataset can be used for high-level scene understanding and fine-grained scene recognition. Source: Zero-Shot Learning with Multi-Battery Factor Analysis Image Source: https://cs.brown.edu/~gmpatter/sunattributes.html

관련 논문 38편

Synthesized Lakh Dataset

Slakh2100
Slakh2100 설명 보기

The Synthesized Lakh (Slakh) Dataset is a dataset for audio source separation that is synthesized from the Lakh MIDI Dataset v0.1 using professional-grade sample-based virtual instruments. This first release of Slakh, called Slakh2100, contains 2100 automatically mixed tracks and accompanying MIDI files synthesized using a professional-grade sampling engine. The tracks in Slakh2100 are split into training (1500 tracks), validation (375 tracks), and test (225 tracks) subsets, totaling 145 hours of mixtures. Source: http://www.slakh.com/ Image Source: http://www.slakh.com/ Audio Source: http://www.slakh.com/

관련 논문 38편

Tatoeba

Tatoeba 설명 보기

Tatoeba is a free collection of example sentences with translations geared towards foreign language learners. It is available in more than 400 languages. Its name comes from the Japanese phrase “tatoeba” (例えば), meaning “for example”. It is written and maintained by a community of volunteers through a model of open collaboration. Individual contributors are known as Tatoebans.

관련 논문 38편

TyDiQA-GoldP

TyDiQA-GoldP 설명 보기

TyDiQA is the gold passage version of the Typologically Diverse Question Answering (TyDiWA) dataset, a benchmark for information-seeking question answering, which covers nine languages. The gold passage version is a simplified version of the primary task, which uses only the gold passage as context and excludes unanswerable questions. It is thus similar to XQuAD and MLQA, while being more challenging as questions have been written without seeing the answers, leading to 3× and 2× less lexical overlap compared to XQuAD and MLQA respectively. Source: XTREME

관련 논문 38편

University of Rochester Multi-Modal Musical Performance

URMP
URMP 설명 보기

URMP (University of Rochester Multi-Modal Musical Performance) is a dataset for facilitating audio-visual analysis of musical performances. The dataset comprises 44 simple multi-instrument musical pieces assembled from coordinated but separately recorded performances of individual tracks. For each piece the dataset provided the musical score in MIDI format, the high-quality individual instrument audio recordings and the videos of the assembled pieces. Source: http://www2.ece.rochester.edu/projects/air/projects/URMP.html Image Source: http://www2.ece.rochester.edu/projects/air/projects/URMP.html Audio Source: http://www2.ece.rochester.edu/projects/air/projects/URMP.html

관련 논문 38편

Whole abdominal Organs Dataset

WORD
WORD 설명 보기

WORD is a dataset for organ semantic segmentation that contains 150 abdominal CT volumes (30,495 slices) and each volume has 16 organs with fine pixel-level annotations and scribble-based sparse annotation, which may be the largest dataset with whole abdominal organs annotation.

관련 논문 37편

A*3D

A*3D 설명 보기

The A*3D dataset is a step forward to make autonomous driving safer for pedestrians and the public in the real world. Characteristics: * 230K human-labeled 3D object annotations in 39,179 LiDAR point cloud frames and corresponding frontal-facing RGB images. * Captured at different times (day, night) and weathers (sun, cloud, rain). Source: https://github.com/I2RDL2/ASTAR-3D Image Source: https://github.com/I2RDL2/ASTAR-3D

관련 논문 37편

Cambrian Vision-Centric Benchmark

CV-Bench
CV-Bench 설명 보기

The Cambrian Vision-Centric Benchmark (CV-Bench) is designed to address the limitations of existing vision-centric benchmarks by providing a comprehensive evaluation framework for multimodal large language models (MLLMs). With 2,638 manually-inspected examples, CV-Bench significantly surpasses other vision-centric MLLM benchmarks, offering 3.5 times more examples than RealWorldQA and 8.8 times more than MMVP. Motivation and Content Summary: CV-Bench repurposes standard vision benchmarks such as ADE20K, COCO, and Omni3D to assess models on classic vision tasks within a multimodal context. Leveraging the rich ground truth annotations from these benchmarks, natural language questions are formulated to probe the fundamental 2D and 3D understanding of models. Potential Use Cases: - Evaluating the spatial relationship and object counting capabilities of models (2D understanding). - Assessing the depth order and relative distance understanding of models (3D understanding). - Benchmarking the performance of multimodal models in both vision-specific and cross-modal tasks. Dataset Characteristics: - 2D Understanding Tasks: - Spatial Relationship: Determine the relative position of an object with respect to the anchor object, considering left-right or top-bottom relationships. - Object Count: Determine the number of instances present in the image. - 3D Understanding Tasks: - Depth Order: Determine which of the two distinct objects is closer to the camera. - Relative Distance: Determine which of the two distinct objects is closer to the anchor object. | Type | Task | Description | Sources | # Samples | |------|----------------------|-----------------------------------------------------------------------------|----------------|-----------| | 2D | Spatial Relationship | Determine the relative position of an object w.r.t. the anchor object. | ADE20K, COCO | 650 | | 2D | Object Count | Determine the number of instances present in the image. | ADE20K, COCO | 788 | | 3D | Depth Order | Determine which of the two distinct objects is closer to the camera. | Omni3D | 600 | | 3D | Relative Distance | Determine which of the two distinct objects is closer to the anchor object. | Omni3D | 600 | Curation Process: Questions for each task are programmatically constructed and then manually inspected to ensure clarity and accuracy. Any unclear, ambiguous, or erroneous questions are removed to maintain the benchmark's reliability.

관련 논문 37편

HumanAct12

HumanAct12 설명 보기

HumanAct12 is a new 3D human motion dataset adopted from the polar image and 3D pose dataset PHSPD, with proper temporal cropping and action annotating. Statistically, there are 1191 3D motion clips(and 90,099 poses in total) which are categorized into 12 action classes, and 34 fine-grained sub-classes. The action types includes daily actions such as walk, run, sit down, jump up, warm up, etc. Fine-grained action types contain more specific information like Warm up by bowing left side, Warm up by pressing left leg, etc. Source: Action2Motion: Conditioned Generation of 3D Human Motions

관련 논문 37편

Learn2Reg

Learn2Reg 설명 보기

Learn2Reg is a dataset for medical image registration. Learn2Reg covers a wide range of anatomies (brain, abdomen, and thorax), modalities (ultrasound, CT, MR), availability of annotations, as well as intra- and inter-patient registration evaluation.

관련 논문 37편

NH-HAZE

NH-HAZE 설명 보기

NN-HAZE is an image dehazing dataset. Since in many real cases haze is not uniformly distributed NH-HAZE, a non-homogeneous realistic dataset with pairs of real hazy and corresponding haze-free images. This is the first non-homogeneous image dehazing dataset and contains 55 outdoor scenes. The non-homogeneous haze has been introduced in the scene using a professional haze generator that imitates the real conditions of hazy scenes. Source: NH-HAZE: An Image Dehazing Benchmark with Non-Homogeneous Hazy and Haze-Free Images

관련 논문 37편

Open Images V4

Open Images V4 설명 보기

Open Images V4 offers large scale across several dimensions: 30.1M image-level labels for 19.8k concepts, 15.4M bounding boxes for 600 object classes, and 375k visual relationship annotations involving 57 classes. For object detection in particular, 15x more bounding boxes than the next largest datasets (15.4M boxes on 1.9M images) are provided. The images often show complex scenes with several objects (8 annotated objects per image on average). Visual relationships between them are annotated, which support visual relationship detection, an emerging task that requires structured reasoning. Source: The Open Images Dataset V4: Unified image classification, object detection, and visual relationship detection at scale Image Source: https://storage.googleapis.com/openimages/web/index.html

관련 논문 37편

Perceptual Image Processing ALgorithms IQA Dataset

PIPAL
PIPAL 설명 보기

PIPAL training set contains 200 reference images, 40 distortion types, 23k distortion images, and more than one million human ratings. Especially, we include GAN-based algorithms’ outputs as a new GAN-based distortion type. We employ the Elo rating system to assign the Mean Opinion Scores (MOS).

관련 논문 37편

SemEval-2018 Task-9

SemEval-2018 Task-9 설명 보기

The SemEval-2018 hypernym discovery evaluation benchmark (Camacho-Collados et al. 2018) contains three domains (general, medical and music) and is also available in Italian and Spanish (not in this repository). For each domain a target corpus and vocabulary (i.e. hypernym search space) are provided. The dataset contains both concepts (e.g. dog) and entities (e.g. Manchester United) up to trigrams. Source: NLP Progress Image source: SemEval-2018 Task 9: Hypernym Discovery

관련 논문 37편

TextOCR

TextOCR 설명 보기

TextOCR is a dataset to benchmark text recognition on arbitrary shaped scene-text. TextOCR requires models to perform text-recognition on arbitrary shaped scene-text present on natural images. TextOCR provides ~1M high quality word annotations on TextVQA images allowing application of end-to-end reasoning on downstream tasks such as visual question answering or image captioning. Dataset statistics: - 28,134 natural images from TextVQA - 903,069 annotated scene-text words - 32 words per image on average

관련 논문 37편

WMT 2018

WMT 2018 설명 보기

WMT 2018 is a collection of datasets used in shared tasks of the Third Conference on Machine Translation. The conference builds on a series of twelve previous annual workshops and conferences on Statistical Machine Translation. The conference featured ten shared tasks: - a news translation task, - a biomedical translation task, - a multimodal machine translation task, - a metrics task, - a quality estimation task, - an automatic post-editing task, - a parallel corpus filtering task. Source: http://www.statmt.org/wmt18/

관련 논문 37편

Yelp Review Polarity

Yelp Review Polarity 설명 보기

The Yelp Reviews Polarity dataset is obtained from the Yelp Dataset Challenge in 2015 (1,569,264 samples that have review text). The polarity label is constructed by considering stars 1 and 2 negative, and 3 and 4 positive. The polarity dataset has 280,000 training samples and 19,000 test samples in each polarity.

관련 논문 37편

iHarmony4

iHarmony4 설명 보기

iHarmony4 is a synthesized dataset for Image Harmonization. It contains 4 sub-datasets: HCOCO, HAdobe5k, HFlickr, and Hday2night (based on COCO, Adobe5k, Flickr, day2night datasets respectively), each of which contains synthesized composite images, foreground masks of composite images and corresponding real images. Source: Image_Harmonization_Datasets

관련 논문 36편

3DSSG

3DSSG 설명 보기

3DSSG provides 3D semantic scene graphs for 3RScan. A semantic scene graph is defined by a set of tuples between nodes and edges where nodes represent specific 3D object instances in a 3D scan. Nodes are defined by its semantics, a hierarchy of classes as well as a set of attributes that describe the visual and physical appearance of the object instance and their affordances. The edges in our graphs are the semantic relationships (predicates) between the nodes such as standing on, hanging on, more comfortable than or same material.

관련 논문 36편

Adversarial GLUE

AdvGLUE
AdvGLUE 설명 보기

Adversarial GLUE (AdvGLUE) is a new multi-task benchmark to quantitatively and thoroughly explore and evaluate the vulnerabilities of modern large-scale language models under various types of adversarial attacks. In particular, we systematically apply 14 textual adversarial attack methods to GLUE tasks to construct AdvGLUE, which is further validated by humans for reliable annotations. Description from: Adversarial GLUE: A Multi-Task Benchmark for Robustness Evaluation of Language Models

관련 논문 36편

BraTS 2013

BraTS 2013 설명 보기

BRATS 2013 is a brain tumor segmentation dataset consists of synthetic and real images, where each of them is further divided into high-grade gliomas (HG) and low-grade gliomas (LG). There are 25 patients with both synthetic HG and LG images and 20 patients with real HG and 10 patients with real LG images. For each patient, FLAIR, T1, T2, and post-Gadolinium T1 magnetic resonance (MR) image sequences are available. Source: Learning Fixed Points in Generative Adversarial Networks: From Image-to-Image Translation to Disease Detection and Localization Image Source: https://arxiv.org/pdf/1708.00377.pdf

관련 논문 36편

Color FERET

Color FERET 설명 보기

The color FERET database is a dataset for face recognition. It contains 11,338 color images of size 512×768 pixels captured in a semi-controlled environment with 13 different poses from 994 subjects. Source: A Comprehensive Analysis of Deep Learning Based Representation for Face Recognition Image Source: https://www.researchgate.net/figure/Sample-results-taken-from-Color-FERET-data-set-testing-using-LBP-algorithm_fig4_308836179

관련 논문 36편

Diverse Real-world image Super-Resolution

DRealSR
DRealSR 설명 보기

DRealSR establishes a Super Resolution (SR) benchmark with diverse real-world degradation processes, mitigating the limitations of conventional simulated image degradation. It has been collected from five DSLR cameras in natural scenes and cover indoor and outdoor scenes avoiding moving objects, e.g., advertising posters, plants, offices, buildings. The training images are cropped into 380×380, 272×272 and 192×192 patches, resulting in 31,970 patches. Source: Component Divide-and-Conquer for Real-World Image Super-Resolution

관련 논문 36편

DialogRE

DialogRE 설명 보기

DialogRE is the first human-annotated dialogue-based relation extraction dataset, containing 1,788 dialogues originating from the complete transcripts of a famous American television situation comedy Friends. The are annotations for all occurrences of 36 possible relation types that exist between an argument pair in a dialogue. DialogRE is available in English and Chinese. Source: DialogRE

관련 논문 36편

Doc2Dial: Document-grounded Dialogue

Doc2Dial
Doc2Dial 설명 보기

For goal-oriented document-grounded dialogs, it often involves complex contexts for identifying the most relevant information, which requires better understanding of the inter-relations between conversations and documents. Meanwhile, many online user-oriented documents use both semi-structured and unstructured contents for guiding users to access information of different contexts. Thus, we create a new goal-oriented document-grounded dialogue dataset that captures more diverse scenarios derived from various document contents from multiple domains such ssa.gov and studentaid.gov. For data collection, we propose a novel pipeline approach for dialogue data construction, which has been adapted and evaluated for several domains.

관련 논문 36편

EBM-NLP

EBM-NLP 설명 보기

EBM-NLP annotates PICO (Participants, Interventions, Comparisons and Outcomes) spans in clinical trial abstracts. The corresponding PICO Extraction task aims to identify the spans in clinical trial abstracts that describe the respective PICO elements.

관련 논문 36편

General Video Game AI

GVGAI
GVGAI 설명 보기

The General Video Game AI (GVGAI) framework is widely used in research which features a corpus of over 100 single-player games and 60 two-player games. These are fairly small games, each focusing on specific mechanics or skills the players should be able to demonstrate, including clones of classic arcade games such as Space Invaders, puzzle games like Sokoban, adventure games like Zelda or game-theory problems such as the Iterative Prisoners Dilemma. All games are real-time and require players to make decisions in only 40ms at every game tick, although not all games explicitly reward or require fast reactions; in fact, some of the best game-playing approaches add up the time in the beginning of the game to run Breadth-First Search in puzzle games in order to find an accurate solution. However, given the large variety of games (many of which are stochastic and difficult to predict accurately), scoring systems and termination conditions, all unknown to the players, highly-adaptive general methods are needed to tackle the diverse challenges proposed. Source: Rolling Horizon Evolutionary Algorithms for General Video Game Playing Image Source: http://www.gvgai.net/

관련 논문 36편

HO-3D v2

HO-3D v2 설명 보기

A hand-object interaction dataset with 3D pose annotations of hand and object. The dataset contains 66,034 training images and 11,524 test images from a total of 68 sequences. The sequences are captured in multi-camera and single-camera setups and contain 10 different subjects manipulating 10 different objects from YCB dataset. The annotations are automatically obtained using an optimization algorithm. The hand pose annotations for the test set are withheld and the accuracy of the algorithms on the test set can be evaluated with standard metrics using the CodaLab challenge submission(see project page). The object pose annotations for the test and train set are provided along with the dataset.

관련 논문 36편

Visual Information Seeking

InfoSeek
InfoSeek 설명 보기

In this project, we introduce InfoSeek, a visual question answering dataset tailored for information-seeking questions that cannot be answered with only common sense knowledge. Using InfoSeek, we analyze various pre-trained visual question answering models and gain insights into their characteristics. Our findings reveal that state-of-the-art pre-trained multi-modal models (e.g., PaLI-X, BLIP2, etc.) face challenges in answering visual information-seeking questions, but fine-tuning on the InfoSeek dataset elicits models to use fine-grained knowledge that was learned during their pre-training.

관련 논문 36편

Joint Track Auto

JTA
JTA 설명 보기

JTA is a dataset for people tracking in urban scenarios by exploiting a photorealistic videogame. It is up to now the vastest dataset (about 500.000 frames, almost 10 million body poses) of human body parts for people tracking in urban scenarios. Source: Learning to Detect and Track Visible and Occluded Body Joints in a Virtual World

관련 논문 36편

Large Scale Underwater Image Dataset

LSUI
LSUI 설명 보기

We released a large-scale underwater image (LSUI) dataset including 5004 image pairs, which involve richer underwater scenes (lighting conditions, water types and target categories) and better visual quality reference images than the existing ones.

관련 논문 36편

Lakh MIDI Dataset

Lakh MIDI Dataset 설명 보기

The Lakh MIDI dataset is a collection of 176,581 unique MIDI files, 45,129 of which have been matched and aligned to entries in the Million Song Dataset. Its goal is to facilitate large-scale music information retrieval, both symbolic (using the MIDI files alone) and audio content-based (using information extracted from the MIDI files as annotations for the matched audio files). Around 10% of all MIDI files include timestamped lyrics events with lyrics are often transcribed at the word, syllable or character level. LMD-full denotes the whole dataset. LMD-matched is the subset of LMD-full that consists of MIDI files matched with the Million Song Dataset entries. LMD-aligned contains all the files of LMD-matched, aligned to preview MP3s from the Million Song Dataset. A lakh is a unit of measure used in the Indian number system which signifies 100,000. Source: https://colinraffel.com/projects/lmd/ Audio Source: https://colinraffel.com/projects/lmd/

관련 논문 36편

MAD

MAD 설명 보기

MAD (Movie Audio Descriptions) is an automatically curated large-scale dataset for the task of natural language grounding in videos or natural language moment retrieval. MAD exploits available audio descriptions of mainstream movies. Such audio descriptions are redacted for visually impaired audiences and are therefore highly descriptive of the visual content being displayed. MAD contains over 384,000 natural language sentences grounded in over 1,200 hours of video, and provides a unique setup for video grounding as the visual stream is truly untrimmed with an average video duration of 110 minutes. 2 orders of magnitude longer than legacy datasets. Take a look at the paper for additional information. From the authors on availability: "Due to copyright constraints, MAD’s videos will not be publicly released. However, we will provide all necessary features for our experiments’ reproducibility and promote future research in this direction"

관련 논문 36편

MM-SafetyBench

MM-SafetyBench 설명 보기

The MultiModal Safety Benchmark (MM-SafetyBench) is a comprehensive framework designed for conducting safety-critical evaluations of Multimodal Large Language Models (MLLMs). It addresses the security concerns surrounding MLLMs, which can be compromised by query-relevant images, as if the text query itself were malicious¹². Here's a brief overview of MM-SafetyBench: - Purpose: It aims to evaluate the vulnerability of MLLMs to adversarial attacks that use images to manipulate model responses. - Dataset: The benchmark includes a dataset with 13 scenarios, resulting in a total of 5,040 text-image pairs. - Evaluation: It has been used to assess the safety of 12 state-of-the-art MLLMs, revealing their susceptibility to image-based manipulations¹. - Significance: The findings from MM-SafetyBench highlight the need for improved safety measures in open-source MLLMs to protect against potential malicious exploits². (1) GitHub - isXinLiu/MM-SafetyBench. https://github.com/isXinLiu/MM-SafetyBench. (2) MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large .... https://arxiv.org/abs/2311.17600. (3) MM-SafetyBench: A Benchmark for Safety Evaluation of Multimodal Large .... https://paperswithcode.com/paper/query-relevant-images-jailbreak-large-multi. (4) Official github repo for SafetyBench, a comprehensive benchmark to .... https://github.com/thu-coai/SafetyBench. (5) undefined. https://doi.org/10.48550/arXiv.2311.17600.

관련 논문 36편

Microsoft Malware Classification Challenge

Microsoft Malware Classification Challenge 설명 보기

The Microsoft Malware Classification Challenge was announced in 2015 along with a publication of a huge dataset of nearly 0.5 terabytes, consisting of disassembly and bytecode of more than 20K malware samples. Apart from serving in the Kaggle competition, the dataset has become a standard benchmark for research on modeling malware behaviour. To date, the dataset has been cited in more than 50 research papers. Here we provide a high-level comparison of the publications citing the dataset. The comparison simplifies finding potential research directions in this field and future performance evaluation of the dataset.