Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 18편

3D60

3D60 설명 보기

Collects high quality 360 datasets with ground truth depth annotations, by re-using recently released large scale 3D datasets and re-purposing them to 360 via rendering. Source: OmniDepth: Dense Depth Estimation for Indoors Spherical Panoramas

관련 논문 18편

Tiny Object Detection in Aerial Images

AI-TOD
AI-TOD 설명 보기

AI-TOD comes with 700,621 object instances for eight categories across 28,036 aerial images. Compared to existing object detection datasets in aerial images, the mean size of objects in AI-TOD is about 12.8 pixels, which is much smaller than others.

관련 논문 18편

ActivityNet Entities

ActivityNet Entities 설명 보기

ActivityNet-Entities, augments the challenging ActivityNet Captions dataset with 158k bounding box annotations, each grounding a noun phrase. This allows training video description models with this data, and importantly, evaluate how grounded or "true" such model are to the video they describe. Source: https://github.com/facebookresearch/ActivityNet-Entities Image Source: https://github.com/facebookresearch/ActivityNet-Entities

관련 논문 18편

AggreFact

AggreFact 설명 보기

The AggreFact dataset is a benchmark for evaluating the factuality of summaries generated by different summarization models. It aggregates factuality error annotations from nine existing datasets and stratifies them according to the underlying summarization model. The dataset contains the following columns: - dataset: Name of the original annotated dataset. - origin: Summarization dataset. Either cnndm or xsum. - id: Document id. - doc: Input article. - summary: Model generated summary. - model_name: Name of the model used to generate the summary. - label: Factual consistency of the generated summary. 1 is factually consistent, 0 otherwise. - cut: Either val or test. - system _score: The output score from a factuality system. - system _label: The binary factual consistency label based on the score of the factuality system.

관련 논문 18편

Agriculture-Vision

Agriculture-Vision 설명 보기

A large-scale aerial farmland image dataset for semantic segmentation of agricultural patterns. Collects 94,986 high-quality aerial images from 3,432 farmlands across the US, where each image consists of RGB and Near-infrared (NIR) channels with resolution as high as 10 cm per pixel. Source: Agriculture-Vision: A Large Aerial Image Database for Agricultural Pattern Analysis

관련 논문 18편

Amazon Beauty 5-core

Amazon Beauty
Amazon Beauty 설명 보기

This dataset includes reviews (ratings, text, helpfulness votes), product metadata (descriptions, category information, price, brand, and image features), and links (also viewed/also bought graphs).

관련 논문 18편

BBC-Oxford British Sign Language

BOBSL
BOBSL 설명 보기

BOBSL is a large-scale dataset of British Sign Language (BSL). It comprises 1,962 episodes (approximately 1,400 hours) of BSL-interpreted BBC broadcast footage accompanied by written English subtitles. From horror, period and medical dramas, history, nature and science documentaries, sitcoms, children’s shows and programs covering cooking, beauty, business and travel, BOBSL covers a wide range of topics. The dataset features a total of 39 signers. Distinct signers appear in the training, validation and test sets for signer-independent evaluation. Description from: BOBSL: BBC-Oxford British Sign Language Dataset

관련 논문 18편

BURST

BURST 설명 보기

BURST is a benchmark suite built upon TAO that requires tracking and segmenting multiple objects from camera video. The benchmark contains 6 different sub-tasks divided into 2 groups that all share the same data for training/validation/testing. ##### Class-guided 1. Common: Track and segment all objects belonging to a set of 78 common classes (based on the COCO class set) 2. Long-tail: Track and segment all objects belonging to an extended set of 482 object classes (based on the LVIS class set) 3. Open-world: Methods are only allowed to use the annotations of the 78 common classes during training, but during inference they are expected to track and segment all 482 object classes (class label predictions are not required) ##### Exemplar-guided 4. Mask: Track and segment all objects in the video for which the first-frame object masks are given. This task is identical to Video Object Segmentation (VOS). 5. Box: Track and segment all objects in the video for which the first-frame object bounding-boxes are given. 6. Point: Track and segment all objects in the video for which we are only given the (x,y) point coordinates of the mask centroid in the first-frame in which the objects appear. An illustration of the task hierarchy is given here and a detailed explanation is given in Sec. 5 of the dataset paper

관련 논문 18편

Bridge Data

Bridge Data 설명 보기

Bridge Data is a large multi-domain and multi-task dataset, with 7,200 demonstrations constituting 71 tasks across 10 environments. The dataset is collected using a low-cost yet versatile 6-DoF WidowX250 robot arm and contains 7,200 demonstrations of a robot performing 71 kitchen tasks across 10 environments with varying lighting, robot positions, and backgrounds. It can be used to boosting generalization of robotic skills and empirically study how it can improve the learning of new tasks in new environments. Image source: https://arxiv.org/pdf/2109.13396v1.pdf

관련 논문 18편

CASIA-B

CASIA-B 설명 보기

CASIA-B is a large multiview gait database, which is created in January 2005. There are 124 subjects, and the gait data was captured from 11 views. Three variations, namely view angle, clothing and carrying condition changes, are separately considered. Besides the video files, we still provide human silhouettes extracted from video files. The detailed information about Dataset B and an evaluation framework can be found in this paper . The format of the video filename in Dataset B is 'xxx-mm-nn-ttt.avi', where xxx: subject id, from 001 to 124. mm: walking status, can be 'nm' (normal), 'cl' (in a coat) or 'bg' (with a bag). nn: sequence number. ttt: view angle, can be '000', '018', ..., '180'.

관련 논문 18편

Car Crash Dataset

CCD
CCD 설명 보기

Car Crash Dataset (CCD) is collected for traffic accident analysis. It contains real traffic accident videos captured by dashcam mounted on driving vehicles, which is critical to developing safety-guaranteed self-driving systems. CCD is distinguished from existing datasets for diversified accident annotations, including environmental attributes (day/night, snowy/rainy/good weather conditions), whether ego-vehicles involved, accident participants, and accident reason descriptions. Source: https://github.com/Cogito2012/CarCrashDataset Image Source: https://github.com/Cogito2012/CarCrashDataset

관련 논문 18편

Intrusion Detection Evaluation Dataset (CIC-IDS2017)

CICIDS2017
CICIDS2017 설명 보기

Intrusion Detection Evaluation Dataset (CIC-IDS2017) Intrusion Detection Systems (IDSs) and Intrusion Prevention Systems (IPSs) are the most important defense tools against the sophisticated and ever-growing network attacks. Due to the lack of reliable test and validation datasets, anomaly-based intrusion detection approaches are suffering from consistent and accurate performance evolutions. Our evaluations of the existing eleven datasets since 1998 show that most are out of date and unreliable. Some of these datasets suffer from the lack of traffic diversity and volumes, some do not cover the variety of known attacks, while others anonymize packet payload data, which cannot reflect the current trends. Some are also lacking feature set and metadata. CICIDS2017 dataset contains benign and the most up-to-date common attacks, which resembles the true real-world data (PCAPs). It also includes the results of the network traffic analysis using CICFlowMeter with labeled flows based on the time stamp, source, and destination IPs, source and destination ports, protocols and attack (CSV files). Also available is the extracted features definition. Generating realistic background traffic was our top priority in building this dataset. We have used our proposed B-Profile system (Sharafaldin, et al. 2016) to profile the abstract behavior of human interactions and generates naturalistic benign background traffic. For this dataset, we built the abstract behaviour of 25 users based on the HTTP, HTTPS, FTP, SSH, and email protocols. The data capturing period started at 9 a.m., Monday, July 3, 2017 and ended at 5 p.m. on Friday July 7, 2017, for a total of 5 days. Monday is the normal day and only includes the benign traffic. The implemented attacks include Brute Force FTP, Brute Force SSH, DoS, Heartbleed, Web Attack, Infiltration, Botnet and DDoS. They have been executed both morning and afternoon on Tuesday, Wednesday, Thursday and Friday. In our recent dataset evaluation framework (Gharib et al., 2016), we have identified eleven criteria that are necessary for building a reliable benchmark dataset. None of the previous IDS datasets could cover all of the 11 criteria. In the following, we briefly outline these criteria: Complete Network configuration: A complete network topology includes Modem, Firewall, Switches, Routers, and presence of a variety of operating systems such as Windows, Ubuntu and Mac OS X. Complete Traffic: By having a user profiling agent and 12 different machines in Victim-Network and real attacks from the Attack-Network. Labelled Dataset: Section 4 and Table 2 show the benign and attack labels for each day. Also, the details of the attack timing will be published on the dataset document. Complete Interaction: As Figure 1 shows, we covered both within and between internal LAN by having two different networks and Internet communication as well. Complete Capture: Because we used the mirror port, such as tapping system, all traffics have been captured and recorded on the storage server. Available Protocols: Provided the presence of all common available protocols, such as HTTP, HTTPS, FTP, SSH and email protocols. Attack Diversity: Included the most common attacks based on the 2016 McAfee report, such as Web based, Brute force, DoS, DDoS, Infiltration, Heart-bleed, Bot and Scan covered in this dataset. Heterogeneity: Captured the network traffic from the main Switch and memory dump and system calls from all victim machines, during the attacks execution. Feature Set: Extracted more than 80 network flow features from the generated network traffic using CICFlowMeter and delivered the network flow dataset as a CSV file. See our PCAP analyzer and CSV generator. MetaData: Completely explained the dataset which includes the time, attacks, flows and labels in the published paper. The full research paper outlining the details of the dataset and its underlying principles: Iman Sharafaldin, Arash Habibi Lashkari, and Ali A. Ghorbani, “Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization”, 4th International Conference on Information Systems Security and Privacy (ICISSP), Purtogal, January 2018 Day, Date, Description, Size (GB) Monday, Normal Activity, 11.0G Tuesday, attacks + Normal Activity, 11G Wednesday, attacks + Normal Activity, 13G Thursday, attacks + Normal Activity, 7.8G Friday, attacks + Normal Activity, 8.3G Victim and attacker networks information Firewall: 205.174.165.80, 172.16.0.1 DNS+ DC Server: 192.168.10.3 Outsiders (Attackers network) Kali: 205.174.165.73 Win: 205.174.165.69, 70, 71 Insiders (Victim network) Web server 16 Public: 192.168.10.50, 205.174.165.68 Ubuntu server 12 Public: 192.168.10.51, 205.174.165.66 Ubuntu 14.4, 32B: 192.168.10.19 Ubuntu 14.4, 64B: 192.168.10.17 Ubuntu 16.4, 32B: 192.168.10.16 Ubuntu 16.4, 64B: 192.168.10.12 Win 7 Pro, 64B: 192.168.10.9 Win 8.1, 64B: 192.168.10.5 Win Vista, 64B: 192.168.10.8 Win 10, pro 32B: 192.168.10.14 Win 10, 64B: 192.168.10.15 MAC: 192.168.10.25 Monday, July 3, 2017 Benign (Normal human activities) Tuesday, July 4, 2017 Brute Force FTP-Patator (9:20 – 10:20 a.m.) SSH-Patator (14:00 – 15:00 p.m.) Attacker: Kali, 205.174.165.73 Victim: WebServer Ubuntu, 205.174.165.68 (Local IP: 192.168.10.50) NAT Process on Firewall: Attack: 205.174.165.73 -> 205.174.165.80 (IP Valid Firewall) -> 172.16.0.10 -> 192.168.10.50 Reply: 192.168.10.50 -> 172.16.0.1 -> 205.174.165.80 -> 205.174.165.73 Wednesday, July 5, 2017 DoS / DDoS DoS slowloris (9:47 – 10:10 a.m.) DoS Slowhttptest (10:14 – 10:35 a.m.) DoS Hulk (10:43 – 11 a.m.) DoS GoldenEye (11:10 – 11:23 a.m.) Attacker: Kali, 205.174.165.73 Victim: WebServer Ubuntu, 205.174.165.68 (Local IP192.168.10.50) NAT Process on Firewall: Attack: 205.174.165.73 -> 205.174.165.80 (IP Valid Firewall) -> 172.16.0.10 -> 192.168.10.50 Reply: 192.168.10.50 -> 172.16.0.1 -> 205.174.165.80 -> 205.174.165.73 Heartbleed Port 444 (15:12 - 15:32) Attacker: Kali, 205.174.165.73 Victim: Ubuntu12, 205.174.165.66 (Local IP192.168.10.51) NAT Process on Firewall: Attack: 205.174.165.73 -> 205.174.165.80 (IP Valid Firewall) -> 172.16.0.11 -> 192.168.10.51 Reply: 192.168.10.51 -> 172.16.0.1 -> 205.174.165.80 -> 205.174.165.73 Thursday, July 6, 2017 Morning Web Attack – Brute Force (9:20 – 10 a.m.) Web Attack – XSS (10:15 – 10:35 a.m.) Web Attack – Sql Injection (10:40 – 10:42 a.m.) Attacker: Kali, 205.174.165.73 Victim: WebServer Ubuntu, 205.174.165.68 (Local IP192.168.10.50) NAT Process on Firewall: Attack: 205.174.165.73 -> 205.174.165.80 (IP Valid Firewall) -> 172.16.0.10 -> 192.168.10.50 Reply: 192.168.10.50 -> 172.16.0.1 -> 205.174.165.80 -> 205.174.165.73 Afternoon Infiltration – Dropbox download Meta exploit Win Vista (14:19 and 14:20-14:21 p.m.) and (14:33 -14:35) Attacker: Kali, 205.174.165.73 Victim: Windows Vista, 192.168.10.8 Infiltration – Cool disk – MAC (14:53 p.m. – 15:00 p.m.) Attacker: Kali, 205.174.165.73 Victim: MAC, 192.168.10.25 Infiltration – Dropbox download Win Vista (15:04 – 15:45 p.m.) First Step: Attacker: Kali, 205.174.165.73 Victim: Windows Vista, 192.168.10.8 Second Step (Portscan + Nmap): Attacker:Vista, 192.168.10.8 Victim: All other clients Friday, July 7, 2017 Morning Botnet ARES (10:02 a.m. – 11:02 a.m.) Attacker: Kali, 205.174.165.73 Victims: Win 10, 192.168.10.15 + Win 7, 192.168.10.9 + Win 10, 192.168.10.14 + Win 8, 192.168.10.5 + Vista, 192.168.10.8 Afternoon Port Scan: Firewall Rule on (13:55 – 13:57, 13:58 – 14:00, 14:01 – 14:04, 14:05 – 14:07, 14:08 - 14:10, 14:11 – 14:13, 14:14 – 14:16, 14:17 – 14:19, 14:20 – 14:21, 14:22 – 14:24, 14:33 – 14:33, 14:35 - 14:35) Firewall rules off (sS 14:51-14:53, sT 14:54-14:56, sF 14:57-14:59, sX 15:00-15:02, sN 15:03-15:05, sP 15:06-15:07, sV 15:08-15:10, sU 15:11-15:12, sO 15:13-15:15, sA 15:16-15:18, sW 15:19-15:21, sR 15:22-15:24, sL 15:25-15:25, sI 15:26-15:27, b 15:28-15:29) Attacker: Kali, 205.174.165.73 Victim: Ubuntu16, 205.174.165.68 (Local IP: 192.168.10.50) NAT Process on Firewall: Attacker: 205.174.165.73 -> 205.174.165.80 (IP Valid Firewall) -> 172.16.0.1 Afternoon DDoS LOIT (15:56 – 16:16) Attackers: Three Win 8.1, 205.174.165.69 - 71 Victim: Ubuntu16, 205.174.165.68 (Local IP: 192.168.10.50) NAT Process on Firewall: Attackers: 205.174.165.69, 70, 71 -> 205.174.165.80 (IP Valid Firewall) -> 172.16.0.1 License The CICIDS2017 dataset consists of labeled network flows, including full packet payloads in pcap format, the corresponding profiles and the labeled flows (GeneratedLabelledFlows.zip) and CSV files for machine and deep learning purpose (MachineLearningCSV.zip) are publicly available for researchers. If you are using our dataset, you should cite our related paper which outlining the details of the dataset and its underlying principles: Iman Sharafaldin, Arash Habibi Lashkari, and Ali A. Ghorbani, “Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization”, 4th International Conference on Information Systems Security and Privacy (ICISSP), Portugal, January 2018

관련 논문 18편

CLEVR-Humans

CLEVR-Humans 설명 보기

We collect a new dataset of human-posed free-form natural language questions about CLEVR images. Many of these questions have out-of-vocabulary words and require reasoning skills that are absent from our model’s repertoire

관련 논문 18편

Comprehensive Medical Benchmark in Chinese

CMB
CMB 설명 보기

CMB is a comprehensive, multi-level Medical Benchmark in Chinese. It encompasses 280,839 multiple-choice questions and 74 complex case consultation questions, covering all clinical medical specialties and various professional levels. The platform aims to holistically evaluate a model's medical knowledge and clinical consultation capabilities.

관련 논문 18편

Code Information Retrieval Benchmark

CoIR
CoIR 설명 보기

CoIR (Code Information Retrieval) benchmark, is designed to evaluate code retrieval capabilities. CoIR includes 10 curated code datasets, covering 8 retrieval tasks across 7 domains. In total, it encompasses two million documents. It also provides a common and easy Python framework, installable via pip, and shares the same data schema as benchmarks like MTEB and BEIR for easy cross-benchmark evaluations.

관련 논문 18편

Cross-Modality Domain Adaptation

CrossMoDA
CrossMoDA 설명 보기

**CrossMoDA is a large and multi-class benchmark for unsupervised cross-modality Domain Adaptation. The goal of the challenge is to segment two key brain structures involved in the follow-up and treatment planning of vestibular schwannoma (VS): the VS and the cochleas. Currently, the diagnosis and surveillance in patients with VS are commonly performed using contrast-enhanced T1 (ceT1) MR imaging.

관련 논문 18편

Deutsche Welle corpus for Information Extraction

DWIE
DWIE 설명 보기

The 'Deutsche Welle corpus for Information Extraction' (DWIE) is a multi-task dataset that combines four main Information Extraction (IE) annotation sub-tasks: (i) Named Entity Recognition (NER), (ii) Coreference Resolution, (iii) Relation Extraction (RE), and (iv) Entity Linking. DWIE is conceived as an entity-centric dataset that describes interactions and properties of conceptual entities on the level of the complete document. Source: https://arxiv.org/abs/2009.12626

관련 논문 18편

DoQA

DoQA 설명 보기

A dataset with 2,437 dialogues and 10,917 QA pairs. The dialogues are collected from three Stack Exchange sites using the Wizard of Oz method with crowdsourcing. Source: DoQA -- Accessing Domain-Specific FAQs via Conversational QA

관련 논문 18편

VisDrone-DroneVehicle

DroneVehicle
DroneVehicle 설명 보기

The DroneVehicle dataset consists of a total of 56,878 images collected by the drone, half of which are RGB images, and the resting are infrared images. We have made rich annotations with oriented bounding boxes for the five categories. Among them, car has 389,779 annotations in RGB images, and 428,086 annotations in infrared images, truck has 22,123 annotations in RGB images, and 25,960 annotations in infrared images, bus has 15,333 annotations in RGB images, and 16,590 annotations in infrared images, van has 11,935 annotations in RGB images, and 12,708 annotations in infrared images, and freight car has 13,400 annotations in RGB images, and 17,173 annotations in infrared image. This dataset is available on the download page. In DroneVehicle, to annotate the objects at the image boundaries, we set a white border with a width of 100 pixels on the top, bottom, left and right of each image, so that the downloaded image scale is 840 x 712. When training our detection network, we can perform pre-processing to remove the surrounding white border and change the image scale to 640 x 512.

관련 논문 18편

Extreme Multi-label Classification

EXTREME CLASSIFICATION
EXTREME CLASSIFICATION 설명 보기

The objective in extreme multi-label classification is to learn feature architectures and classifiers that can automatically tag a data point with the most relevant subset of labels from an extremely large label set. This repository provides resources that can be used for evaluating the performance of extreme multi-label algorithms including datasets, code, and metrics. For more details please visit the link http://manikvarma.org/downloads/XC/XMLRepository.html

관련 논문 18편

Elliptic Dataset

Elliptic Dataset 설명 보기

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

관련 논문 18편

Endomapper

Endomapper 설명 보기

The Endomapper dataset is the first collection of complete endoscopy sequences acquired during regular medical practice, including slow and careful screening explorations, making secondary use of medical data. Its original purpose is to facilitate the development and evaluation of VSLAM (Visual Simultaneous Localization and Mapping) methods in real endoscopy data. The first release of the dataset is composed of 50 sequences with a total of more than 13 hours of video. It is also the first endoscopic dataset that includes both the computed geometric and photometric endoscope calibration as well as the original calibration videos. Meta-data and annotations associated to the dataset varies from anatomical landmark and description of the procedure labeling, tools segmentation masks, COLMAP 3D reconstructions, simulated sequences with groundtruth and meta-data related to special cases, such as sequences from the same patient. This information will improve the research in endoscopic VSLAM, as well as other research lines, and create new research lines.

관련 논문 18편

Enron Emails

Enron Emails 설명 보기

This dataset was collected and prepared by the CALO Project (A Cognitive Assistant that Learns and Organizes). It contains data from about 150 users, mostly senior management of Enron, organized into folders. The corpus contains a total of about 0.5M messages. This data was originally made public, and posted to the web, by the Federal Energy Regulatory Commission during its investigation.

관련 논문 18편

FineDance

FineDance 설명 보기

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

관련 논문 18편

Florence3D

Florence3D 설명 보기

The dataset collected at the University of Florence during 2012, has been captured using a Kinect camera. It includes 9 activities: wave, drink from a bottle, answer phone,clap, tight lace, sit down, stand up, read watch, bow. During acquisition, 10 subjects were asked to perform the above actions for 2/3 times. This resulted in a total of 215 activity samples. Source: https://www.micc.unifi.it/resources/datasets/florence-3d-actions-dataset/ Image Source: https://www.micc.unifi.it/resources/datasets/florence-3d-actions-dataset/

관련 논문 18편

HOST

HOST 설명 보기

The heavily occluded scene text (HOST) dataset is a dataset that contains images of text with occlusions. It is used to improve the recognition performance of occluded text in machine vision applications 1. The dataset is composed of 4832 images that are manually occluded in weak or heavy degrees.

관련 논문 18편

Kennedy Space Center

Kennedy Space Center 설명 보기

Kennedy Space Center is a dataset for the classification of wetland vegetation at the Kennedy Space Center, Florida using hyperspectral imagery. Hyperspectral data were acquired over KSC on March 23, 1996 using JPL's Airborne Visible/Infrared Imaging Spectrometer.

관련 논문 18편

KinFaceW-II

KinFaceW-II 설명 보기

KinFaceW-II Dataset consists of 1000 pairs of facial images of individuals with a kin relation. This database also considers four common kin relations: father and daughter (F-D), father and son (F-S), mother and daughter (M-D), mother and son (M-S). Different from the KinFaceW-I database, the positive pairs in this dataset are taken from the same photo. Image Source: Neighborhood Repulsed Metric Learning for Kinship Verification

관련 논문 18편

KoNViD-1k VQA Database

KoNViD-1k
KoNViD-1k 설명 보기

Subjective video quality assessment (VQA) strongly depends on semantics, context, and the types of visual distortions. A lot of existing VQA databases cover small numbers of video sequences with artificial distortions. When testing newly developed Quality of Experience (QoE) models and metrics, they are commonly evaluated against subjective data from such databases, that are the result of perception experiments. However, since the aim of these QoE models is to accurately predict natural videos, these artificially distorted video databases are an insufficient basis for learning. Additionally, the small sizes make them only marginally usable for state-of-the-art learning systems, such as deep learning. In order to give a better basis for development and evaluation of objective VQA methods, we have created a larger datasets of natural, real-world video sequences with corresponding subjective mean opinion scores (MOS) gathered through crowdsourcing. ​ We took YFCC100m as a baseline database, consisting of 793436 Creative Commons (CC) video sequences, filtered them through multiple steps to ensure that the video sequences are representative of the whole spectrum of available video content, types of distortions, and subjective quality. The resulting 1200 videos are available to download, alongside the subjective data and evaluation of the best-performing techniques available for multiple video attributes. Namely, we have evaluated blur, colorfulness, contrast, spatial information, temporal information and video quality.

관련 논문 18편

KorNLI

KorNLI 설명 보기

KorNLI is a Korean Natural Language Inference (NLI) dataset. The dataset is constructed by automatically translating the training sets of the SNLI, XNLI and MNLI datasets. To ensure translation quality, two professional translators with at least seven years of experience who specialize in academic papers/books as well as business contracts post-edited a half of the dataset each and cross-checked each other’s translation afterward. It contains 942,854 training examples translated automatically and 7,500 evaluation (development and test) examples translated manually Source: https://github.com/kakaobrain/KorNLUDatasets

관련 논문 18편

LIVE (Public-Domain Subjective Image Quality Database)

LIVE (Public-Domain Subjective Image Quality Database) 설명 보기

The LIVE Public-Domain Subjective Image Quality Database is a resource developed by the Laboratory for Image and Video Engineering at the University of Texas at Austin. It contains a set of images and videos whose quality has been ranked by human subjects. This database is used in Quality Assessment (QA) research, which aims to make quality predictions that align with the subjective opinions of human observers. The database was created through an extensive experiment conducted in collaboration with the Department of Psychology at the University of Texas at Austin. The experiment involved obtaining scores from human subjects for many images distorted with different distortion types. The QA algorithm may be trained on part of this data set, and tested on the rest. The database is available to the research community free of charge. If you use these images in your research, the creators kindly ask that you reference their website and their papers. There are two releases of the database. Release 2 includes more distortion types and more subjects than Release 1. The distortions include JPEG-compressed images, JPEG2000-compressed images, Gaussian blur, and white noise.

관련 논문 18편

Label-free In Vitro image Examples of Cells

LIVECell
LIVECell 설명 보기

The LIVECell (Label-free In Vitro image Examples of Cells) dataset is a large-scale microscopic image dataset for instance-segmentation of individual cells in 2D cell cultures. LIVECell consists of 5,239 manually annotated, expert-validated, Incucyte HD phase-contrast microscopy images with a total of 1,686,352 individual cells annotated from eight different cell types (average 313 cells per image). The LIVECell images have predefined splits into training (3188), validation (539) and test (1512) sets. Each split is also further subdivided into each of the eight cell types. The training set also has splits of different sizes (2, 4, 5, 25, 50%) to allow dataset size experimentation.

관련 논문 18편

LSHTC

LSHTC 설명 보기

LSHTC is a dataset for large-scale text classification. The data used in the LSHTC challenges originates from two popular sources: the DBpedia and the ODP (Open Directory Project) directory, also known as DMOZ. DBpedia instances were selected from the english, non-regional Extended Abstracts provided by the DBpedia site. The DMOZ instances consist of either Content vectors, Description vectors or both. A Content vectors is obtained by directly indexing the web page using standard indexing chain (preprocessing, stemming/lemmatization, stop-word removal). Source: LSHTC: A Benchmark for Large-Scale Text Classification

관련 논문 18편

Monotonicity Entailment Dataset

MED
MED 설명 보기

MED is a new evaluation dataset that covers a wide range of monotonicity reasoning that was created by crowdsourcing and collected from linguistics publications. The dataset was constructed by collecting naturally-occurring examples by crowdsourcing and well-designed ones from linguistics publications. It consists of 5,382 examples. Source: https://github.com/verypluming/MED Image Source: https://www.aclweb.org/anthology/W19-4804v2.pdf

관련 논문 18편

Multimodal Dialogs

MMD
MMD 설명 보기

The MMD (MultiModal Dialogs) dataset is a dataset for multimodal domain-aware conversations. It consists of over 150K conversation sessions between shoppers and sales agents, annotated by a group of in-house annotators using a semi-automated manually intense iterative process. Source: Towards Building Large Scale Multimodal Domain-Aware Conversation Systems

관련 논문 18편

MSU Full-Reference Video Quality Assessment Database

MSU FR VQA Database
MSU FR VQA Database 설명 보기

The dataset was created for video quality assessment problem. It was formed with 36 clips from Vimeo, which were selected from 18,000+ open-source clips with high bitrate (license CCBY or CC0). The clips include videos recorded by both professionals and amateurs. Almost half of the videos contain scene changes and high dynamism. Moreover, the synthetic to natural lightning ratio is approximately 1 to 3. Content type: nature, sport, humans close up, gameplays, music videos, water stream or steam, CGI Effects and distortions: shaking, slow-motion, grain/noisy, too dark/bright regions, macro shooting, captions (text), extraneous objects on the camera lens or just close to it Resolution: 1920x1080 as the most popular modern video resolution (more in the future) Format: yuv420p FPS: 24, 25, 30, 39, 50, 60 Videos duration: mainly 10 seconds Such content diversity helps simulate near-realistic conditions. The choice of videos collected for the benchmark dataset employed clustering in terms of space-time complexity to obtain a representative distribution. For compression we used 40 codecs of 10 compression standards (H.264, AV1, H.265, VVC, etc.). Each video was compressed with 3 target bitrates: 1,000 Kbps, 2,000 Kbps, and 4,000 Kbps, and different real-life encoding modes: constant quality (CRF) and variable bitrate (VBR). The choice of bitrate range simplifies the subjective comparison procedure since the video quality is more difficult to distinguish visually at higher bitrates. The subjective assessment involved pairwise comparisons using crowdsourcing service Subjectify.us. To increase the relevance of the results, each pair of videos received at least 10 responses from participants. In total, 766362 valid answers were collected from more than 10800 unique participants.

관련 논문 18편

MSU Video Frame Interpolation

MSU Video Frame Interpolation 설명 보기

This is a dataset for video frame interpolation task. The dataset contains the 1920×1080 videos in 240 FPS for videos captured with iPhone 11 and in 120 FPS for gaming content captured with OBS.

관련 논문 18편

MaskedFace-Net

MaskedFace-Net 설명 보기

Proposes three types of masked face detection dataset; namely, the Correctly Masked Face Dataset (CMFD), the Incorrectly Masked Face Dataset (IMFD) and their combination for the global masked face detection (MaskedFace-Net). Source: MaskedFace-Net -- A Dataset of Correctly/Incorrectly Masked Face Images in the Context of COVID-19

관련 논문 18편

MuirBench

MuirBench 설명 보기

MuirBench is a benchmark containing 11,264 images and 2,600 multiple-choice questions, providing robust evaluation on 12 multi-image understanding tasks. - MuirBench evaluates on a comprehensive range of 12 multi-image understanding abilities, e.g. geographic understanding, diagram understanding, visual retrieval, ..., etc, while prior benchmarks generally contain single-image questions. - MuirBench contains 10 diverse multi-image relations, e.g. narrative, complementary, etc. - MuirBench provides a robust evaluation on models by unanswerable instance variants. Three major ways to create the unanswerable instances are as below.

관련 논문 18편

MultiBench

MultiBench 설명 보기

MultiBench, a systematic and unified large-scale benchmark for multimodal learning spanning 15 datasets, 10 modalities, 20 prediction tasks, and 6 research areas. MultiBench provides an automated end-to-end machine learning pipeline that simplifies and standardizes data loading, experimental setup, and model evaluation. To enable holistic evaluation, MultiBench offers evaluation methodology to study (1) generalization, (2) time and space complexity, and (3) modality robustness.

관련 논문 18편

ODEX

ODEX 설명 보기

ODEX is an open-domain 📖, multilingual 🌍, execution-based 🛠 natural language to code generation 💻 data benchmark. ODEX has 945 NL-Code pairs spanning 79 diverse libraries, along with 1,707 human-written test cases for execution. The NL-Code pairs are harvested from StackOverflow forums to encourage natural and practical coding queries. Moreover, ODEX supports four natural languages as intents: English, español (Spanish), 日本語 (Japanese), and Pусский (Russian).