Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 66편

Common Voice Speech-To-Text 2

CoVoST2
CoVoST2 설명 보기

End-to-end speech-to-text translation (ST) has recently witnessed an increased interest given its system simplicity, lower inference latency and less compounding errors compared to cascaded ST (i.e. speech recognition + machine translation). End-to-end ST model training, however, is often hampered by the lack of parallel data. Thus, we created CoVoST, a large-scale multilingual ST corpus based on Common Voice, to foster ST research with the largest ever open dataset. Its latest version covers translations from English into 15 languages---Arabic, Catalan, Welsh, German, Estonian, Persian, Indonesian, Japanese, Latvian, Mongolian, Slovenian, Swedish, Tamil, Turkish, Chinese---and from 21 languages into English, including the 15 target languages as well as Spanish, French, Italian, Dutch, Portuguese, Russian. It has total 2,880 hours of speech and is diversified with 78K speakers.

관련 논문 66편

MSRVTT-QA

MSRVTT-QA 설명 보기

The MSR-VTT-QA dataset is a benchmark for the task of Visual Question Answering (VQA) on the MSR-VTT (Microsoft Research Video to Text) dataset. The MSR-VTT-QA benchmark is used to evaluate models on their ability to answer questions based on these videos. It's part of the tasks that this dataset is used for, along with Video Retrieval, Video Captioning, Zero-Shot Video Question Answering, Zero-Shot Video Retrieval, and Text-to-Video Generation.

관련 논문 66편

Numenta Anomaly Benchmark

NAB
NAB 설명 보기

The First Temporal Benchmark Designed to Evaluate Real-time Anomaly Detectors Benchmark The growth of the Internet of Things has created an abundance of streaming data. Finding anomalies in this data can provide valuable insights into opportunities or failures. Yet it’s difficult to achieve, due to the need to process data in real time, continuously learn and make predictions. How do we evaluate and compare various real-time anomaly detection techniques? The Numenta Anomaly Benchmark (NAB) provides a standard, open source framework for evaluating real-time anomaly detection algorithms on streaming data. Through a controlled, repeatable environment of open-source tools, NAB rewards detectors that find anomalies as soon as possible, trigger no false alarms, and automatically adapt to any changing statistics. NAB comprises two main components: a scoring system designed for streaming data and a dataset with labeled, real-world time-series data. Source: Evaluating Real-time Anomaly Detection Algorithms – the Numenta Anomaly Benchmark Image Source: https://numenta.com/machine-intelligence-technology/numenta-anomaly-benchmark/

관련 논문 66편

Natural Instructions

Natural Instructions 설명 보기

Natural-Instructions is a dataset of 61 distinct tasks, their human-authored instructions and 193k task instances. The instructions are obtained from crowdsourcing instructions used to create existing NLP datasets and mapped to a unified schema.

관련 논문 66편

OCHuman

OCHuman 설명 보기

This dataset focuses on heavily occluded human with comprehensive annotations including bounding-box, humans pose and instance mask. This dataset contains 13,360 elaborately annotated human instances within 5081 images. With average 0.573 MaxIoU of each person, OCHuman is the most complex and challenging dataset related to human. Source: https://github.com/liruilong940607/OCHumanApi Image Source: https://github.com/liruilong940607/OCHumanApi

관련 논문 66편

One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling

One Billion Word Benchmark
One Billion Word Benchmark 설명 보기

Text corpus with almost one billion words of training data for statistical language modeling benchmarking. The scale of approximately one billion words attempts to strike a balance between the relevance of the benchmark in a world of abundant data against the ease with which researchers can evaluate their modeling approaches. Monolingual english data was obtained from the WMT11 website and prepared using a variety of best-practices for machine learning dataset preparations.

관련 논문 66편

ParaCrawl

ParaCrawl 설명 보기

ParaCrawl v.7.1 is a parallel dataset with 41 language pairs primarily aligned with English (39 out of 41) and mined using the parallel-data-crawling tool Bitextor which includes downloading documents, preprocessing and normalization, aligning documents and segments, and filtering noisy data via Bicleaner. ParaCrawl focuses on European languages, but also includes 9 lower-resource, non-European language pairs in v7.1. Source: Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets

관련 논문 66편

Semantic3D

Semantic3D 설명 보기

Semantic3D is a point cloud dataset of scanned outdoor scenes with over 3 billion points. It contains 15 training and 15 test scenes annotated with 8 class labels. This large labelled 3D point cloud data set of natural covers a range of diverse urban scenes: churches, streets, railroad tracks, squares, villages, soccer fields, castles to name just a few. The point clouds provided are scanned statically with state-of-the-art equipment and contain very fine details. Source: Tangent Convolutions for Dense Prediction in 3D Image Source: http://www.semantic3d.net/

관련 논문 66편

WikiHop

WikiHop 설명 보기

WikiHop is a multi-hop question-answering dataset. The query of WikiHop is constructed with entities and relations from WikiData, while supporting documents are from WikiReading. A bipartite graph connecting entities and documents is first built and the answer for each query is located by traversal on this graph. Candidates that are type-consistent with the answer and share the same relation in query with the answer are included, resulting in a set of candidates. Thus, WikiHop is a multi-choice style reading comprehension data set. There are totally about 43K samples in training set, 5K samples in development set and 2.5K samples in test set. The test set is not provided. The task is to predict the correct answer given a query and multiple supporting documents. The dataset includes a masked variant, where all candidates and their mentions in the supporting documents are replaced by random but consistent placeholder tokens. Source: Multi-hop Reading Comprehension across Multiple Documents by Reasoning over Heterogeneous Graphs Image Source: http://qangaroo.cs.ucl.ac.uk/

관련 논문 65편

ACE 2005 Multilingual Training Corpus

ACE 2005
ACE 2005 설명 보기

ACE 2005 Multilingual Training Corpus contains the complete set of English, Arabic and Chinese training data for the 2005 Automatic Content Extraction (ACE) technology evaluation. The corpus consists of data of various types annotated for entities, relations and events by the Linguistic Data Consortium (LDC) with support from the ACE Program and additional assistance from LDC. Source: https://catalog.ldc.upenn.edu/LDC2006T06 Image Source: https://arxiv.org/pdf/1811.06031.pdf

관련 논문 65편

CAD-120

CAD-120 설명 보기

The CAD-60 and CAD-120 data sets comprise of RGB-D video sequences of humans performing activities which are recording using the Microsoft Kinect sensor. Being able to detect human activities is important for making personal assistant robots useful in performing assistive tasks. The CAD dataset comprises twelve different activities (composed of several sub-activities) performed by four people in different environments, such as a kitchen, a living room, and office, etc. Source: https://www.re3data.org/repository/r3d100012216 Image Source: https://www.researchgate.net/figure/The-CAD-120-dataset-A-Examples-of-high-level-activities-from-the-dataset-B-A_fig3_335424041

관련 논문 65편

Composing Actions from Language and Vision

CALVIN
CALVIN 설명 보기

CALVIN (Composing Actions from Language and Vision), is an open-source simulated benchmark to learn long-horizon language-conditioned robot manipulation tasks.

관련 논문 65편

DBP15K

DBP15K 설명 보기

DBP15k contains four language-specific KGs that are respectively extracted from English (En), Chinese (Zh), French (Fr) and Japanese (Ja) DBpedia, each of which contains around 65k-106k entities. Three sets of 15k alignment labels are constructed to align entities between each of the other three languages and En. Source: Cross-lingual Entity Alignment for Knowledge Graphs with Incidental Supervision from Free Text

관련 논문 65편

DuReader

DuReader 설명 보기

DuReader is a large-scale open-domain Chinese machine reading comprehension dataset. The dataset consists of 200K questions, 420K answers and 1M documents. The questions and documents are based on Baidu Search and Baidu Zhidao. The answers are manually generated. The dataset additionally provides question type annotations – each question was manually annotated as either Entity, Description or YesNo and one of Fact or Opinion. Source: https://arxiv.org/pdf/1711.05073v4.pdf Image Source: https://arxiv.org/pdf/1711.05073v4.pdf

관련 논문 65편

Friendster

Friendster 설명 보기

Friendster is an on-line gaming network. Before re-launching as a game website, Friendster was a social networking site where users can form friendship edge each other. Friendster social network also allows users form a group which other members can then join. The Friendster dataset consist of ground-truth communities (based on user-defined groups) and the social network from induced subgraph of the nodes that either belong to at least one community or are connected to other nodes that belong to at least one community. Source: https://snap.stanford.edu/data/com-Friendster.html

관련 논문 65편

MMI Facial Expression Database

MMI
MMI 설명 보기

The MMI Facial Expression Database consists of over 2900 videos and high-resolution still images of 75 subjects. It is fully annotated for the presence of AUs in videos (event coding), and partially coded on frame-level, indicating for each frame whether an AU is in either the neutral, onset, apex or offset phase. A small part was annotated for audio-visual laughters. Source: https://mmifacedb.eu/ Image Source: https://mmifacedb.eu/

관련 논문 65편

MagnaTagATune

MagnaTagATune 설명 보기

MagnaTagATune dataset contains 25,863 music clips. Each clip is a 29-seconds-long excerpt belonging to one of the 5223 songs, 445 albums and 230 artists. The clips span a broad range of genres like Classical, New Age, Electronica, Rock, Pop, World, Jazz, Blues, Metal, Punk, and more. Each audio clip is supplied with a vector of binary annotations of 188 tags. These annotations are obtained by humans playing the two-player online TagATune game. In this game, the two players are either presented with the same or a different audio clip. Subsequently, they are asked to come up with tags for their specific audio clip. Afterward, players view each other’s tags and are asked to decide whether they were presented the same audio clip. Tags are only assigned when more than two players agreed. The annotations include tags like ’singer’, ’no singer’, ’violin’, ’drums’, ’classical’, ’jazz’. The top 50 most popular tags are typically used for evaluation to ensure that there is enough training data for each tag. There are 16 parts, and researchers comonnly use parts 1-12 for training, part 13 for validation and parts 14-16 for testing. Source: Brains on Beats Audio Source: http://mirg.city.ac.uk/codeapps/the-magnatagatune-dataset

관련 논문 65편

Newer College

Newer College 설명 보기

The Newer College Dataset is a large dataset with a variety of mobile mapping sensors collected using a handheld device carried at typical walking speeds for nearly 2.2 km through New College, Oxford. The dataset includes data from two commercially available devices - a stereoscopic-inertial camera and a multi-beam 3D LiDAR, which also provides inertial measurements. Additionally, the authors used a tripod-mounted survey grade LiDAR scanner to capture a detailed millimeter-accurate 3D map of the test location (containing ∼290 million points). Using the map the authors inferred centimeter-accurate 6 Degree of Freedom (DoF) ground truth for the position of the device for each LiDAR scan to enable better evaluation of LiDAR and vision localisation, mapping and reconstruction systems. The dataset combines both built environments, open spaces and vegetated areas so as to test localization and mapping systems such as vision-based navigation, visual and LiDAR SLAM, 3D LIDAR reconstruction and appearance-based place recognition.

관련 논문 65편

Occluded REID

Occluded REID 설명 보기

Occluded REID is an occluded person dataset captured by mobile cameras, consisting of 2,000 images of 200 occluded persons (see Fig. (c)). Each identity has 5 full-body person images and 5 occluded person images with different types of occlusion. Source: Foreground-aware Pyramid Reconstruction for Alignment-free Occluded Person Re-identification Image Source: https://github.com/tinajia2012/ICME2018_Occluded-Person-Reidentification_datasets

관련 논문 65편

PASCAL-Part

PASCAL-Part 설명 보기

PASCAL-Part is a set of additional annotations for PASCAL VOC 2010. It goes beyond the original PASCAL object detection task by providing segmentation masks for each body part of the object. For categories that do not have a consistent set of parts (e.g., boat), it provides the silhouette annotation. It can also serve as a set for human semantic part segmentation: It contains multiple humans per image in unconstrained poses and occlusions (1,716 for training and 1,817 for testing). It provides careful pixel-wise annotations for six body parts (i.e., head, torso, upper/lower-arms, and upper-/lower-legs). Source: The Ultimate Theory of Human Parsing Image Source: https://www.researchgate.net/profile/Zhedong_Zheng/publication/328123707/figure/fig4/AS:704683136016384@1545020960225/Qualitative-parsing-results-on-the-Pascal-Person-Part-dataset.png

관련 논문 65편

Places365

Places365 설명 보기

The Places365 dataset is a scene recognition dataset. It is composed of 10 million images comprising 434 scene classes. There are two versions of the dataset: Places365-Standard with 1.8 million train and 36000 validation images from K=365 scene classes, and Places365-Challenge-2016, in which the size of the training set is increased up to 6.2 million extra images, including 69 new scene classes (leading to a total of 8 million train images from 434 scene classes). Source: Semantic-Aware Scene Recognition Image Source: Places

관련 논문 65편

RotoWire

RotoWire 설명 보기

This dataset consists of (human-written) NBA basketball game summaries aligned with their corresponding box- and line-scores. Summaries taken from rotowire.com are referred to as the "rotowire" data. There are 4853 distinct rotowire summaries, covering NBA games played between 1/1/2014 and 3/29/2017; some games have multiple summaries. The summaries have been randomly split into training, validation, and test sets consisting of 3398, 727, and 728 summaries, respectively. Source: Challenges in Data-to-Document Generation Image Source: https://arxiv.org/pdf/1707.08052v1.pdf

관련 논문 65편

Wildtrack

Wildtrack 설명 보기

Wildtrack is a large-scale and high-resolution dataset. It has been captured with seven static cameras in a public open area, and unscripted dense groups of pedestrians standing and walking. Together with the camera frames, we provide an accurate joint (extrinsic and intrinsic) calibration, as well as 7 series of 400 annotated frames for detection at a rate of 2 frames per second. This results in over 40 000 bounding boxes delimiting every person present in the area of interest, for a total of more than 300 individuals.

관련 논문 64편

Algebra Question Answering with Rationales

AQUA-RAT
AQUA-RAT 설명 보기

Algebra Question Answering with Rationales (AQUA-RAT) is a dataset that contains algebraic word problems with rationales. The dataset consists of about 100,000 algebraic word problems with natural language rationales. Each problem is a json object consisting of four parts: * question - A natural language definition of the problem to solve * options - 5 possible options (A, B, C, D and E), among which one is correct * rationale - A natural language description of the solution to the problem * correct - The correct option Source: https://github.com/deepmind/AQuA

관련 논문 64편

Aspect Sentiment Triplet Extraction

ASTE
ASTE 설명 보기

Target-based sentiment analysis or aspect-based sentiment analysis (ABSA) refers to addressing various sentiment analysis tasks at a fine-grained level, which includes but is not limited to aspect extraction, aspect sentiment classification, and opinion extraction. There exist many solvers of the above individual subtasks or a combination of two subtasks, and they can work together to tell a complete story, i.e. the discussed aspect, the sentiment on it, and the cause of the sentiment. However, no previous ABSA research tried to provide a complete solution in one shot. In this paper, we introduce a new subtask under ABSA, named aspect sentiment triplet extraction (ASTE). Particularly, a solver of this task needs to extract triplets (What, How, Why) from the inputs, which show WHAT the targeted aspects are, HOW their sentiment polarities are and WHY they have such polarities (i.e. opinion reasons). For instance, one triplet from “Waiters are very friendly and the pasta is simply average” could be (‘Waiters’, positive, ‘friendly’). We propose a two-stage framework to address this task. The first stage predicts what, how and why in a unified model, and then the second stage pairs up the predicted what (how) and why from the first stage to output triplets. In the experiments, our framework has set a benchmark performance in this novel triplet extraction task. Meanwhile, it outperforms a few strong baselines adapted from state-of-the-art related methods.

관련 논문 64편

EmpatheticDialogues

EmpatheticDialogues 설명 보기

The EmpatheticDialogues dataset is a large-scale multi-turn empathetic dialogue dataset collected on the Amazon Mechanical Turk, containing 24,850 one-to-one open-domain conversations. Each conversation was obtained by pairing two crowd-workers: a speaker and a listener. The speaker is asked to talk about the personal emotional feelings. The listener infers the underlying emotion through what the speaker says and responds empathetically. The dataset provides 32 evenly distributed emotion labels. Source: Empathetic Dialogue Generation viaKnowledge Enhancing and Emotion Dependency Modeling Image Source: Towards Empathetic Open-domain Conversation Models: A New Benchmark and Dataset

관련 논문 64편

Helpful, Honest, & Harmless

HHH
HHH 설명 보기

The HHH dataset, also known as the Helpful, Honest, & Harmless (HHH) Alignment dataset, is a dataset used for evaluating language models. It is pragmatically broken down into the categories of helpfulness, honesty/accuracy, and harmlessness. The dataset is formatted in terms of binary comparisons, often broken down from a ranked ordering of three or four possible responses to a given query or context. The goal of these evaluations is that on careful reflection, the vast majority of people would agree that the chosen response is better (more helpful, honest, and harmless) than the alternative offered for comparison.

관련 논문 64편

MagicBrush

MagicBrush 설명 보기

MagicBrush is a manually-annotated instruction-guided image editing dataset covering diverse scenarios single-turn, multi-turn, mask-provided, and mask-free editing. MagicBrush comprises 10K (source image, instruction, target image) triples, which is sufficient to train large-scale image editing models. Source: MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing Image Source: MagicBrush: A Manually Annotated Dataset for Instruction-Guided Image Editing

관련 논문 64편

Mall Dataset

Mall
Mall 설명 보기

The Mall is a dataset for crowd counting and profiling research. Its images are collected from publicly accessible webcam. It mainly includes 2,000 video frames, and the head position of every pedestrian in all frames is annotated. A total of more than 60,000 pedestrians are annotated in this dataset. Source: Drone Based RGBT Vehicle Detection and Counting: A Challenge Image Source: http://www.bmva.org/bmvc/2012/BMVC/paper021/paper021.pdf

관련 논문 64편

OSCAR

OSCAR 설명 보기

OSCAR or Open Super-large Crawled ALMAnaCH coRpus is a huge multilingual corpus obtained by language classification and filtering of the Common Crawl corpus using the goclassy architecture. The dataset used for training multilingual models such as BART incorporates 138 GB of text.

관련 논문 64편

TED-LIUM

TED-LIUM 설명 보기

The TED-LIUM corpus consists of English-language TED talks. It includes transcriptions of these talks. The audio is sampled at 16kHz. The dataset spans a range of 118 to 452 hours of transcribed speech data.

관련 논문 64편

XL-Sum

XL-Sum 설명 보기

XL-Sum is a comprehensive and diverse dataset for abstractive summarization comprising 1 million professionally annotated article-summary pairs from BBC, extracted using a set of carefully designed heuristics. The dataset covers 44 languages ranging from low to high-resource, for many of which no public dataset is currently available. XL-Sum is highly abstractive, concise, and of high quality, as indicated by human and intrinsic evaluation.

관련 논문 63편

AgentBench

AgentBench 설명 보기

AgentBench is a comprehensive benchmark designed to evaluate Large Language Models (LLMs) as agents in interactive environments. LLMs, which are increasingly smart and autonomous, have expanded beyond traditional natural language processing tasks to tackle real-world pragmatic missions. Here are the key details about AgentBench: 1. Purpose: AgentBench assesses LLMs' reasoning and decision-making abilities in a multi-turn open-ended generation setting across challenging tasks. 2. Environments: It currently consists of eight distinct environments, each representing different scenarios. These environments include: - SQL-based Environment: Evaluates LLMs' ability to operate with real databases. - Game-based Environment: Tests LLMs in digital card games. - Web-based Environments: Includes web shopping, web browsing, and more. 3. Performance Disparity: After extensive testing of 27 API-based and open-sourced LLMs, it was observed that while top commercial LLMs exhibit strong agent capabilities in complex environments, there is a significant performance gap between them and open-source competitors. 4. Challenges: Poor long-term reasoning, decision-making, and instruction-following abilities are identified as the main obstacles for developing usable LLM agents. 5. Improvement Strategies: Training on code and high-quality multi-turn alignment data could enhance agent performance. 6. Resources: Datasets, environments, and an integrated evaluation package for AgentBench are available¹. In summary, AgentBench provides a rigorous evaluation framework for assessing LLMs' performance as autonomous agents across diverse scenarios. (1) [2308.03688] AgentBench: Evaluating LLMs as Agents - arXiv.org. https://arxiv.org/abs/2308.03688. (2) AGENTBENCH:评估LLMs作为代理的能力 - 知乎 - 知乎专栏. https://zhuanlan.zhihu.com/p/664598024. (3) AgentBench, a comprehensive benchmark for evaluating AI agent .... https://ai-scholar.tech/en/articles/agent-simulation%2Fagentbench. (4) AI-Natural-Language-Processing-Lab/AgentBench-LLM-as-Agent. https://github.com/AI-Natural-Language-Processing-Lab/AgentBench-LLM-as-Agent. (5) AgentBench: Evaluating LLMs as Agents - GitHub. https://github.com/THUDM/AgentBench. (6) undefined. https://doi.org/10.48550/arXiv.2308.03688.

관련 논문 63편

CSL-Daily

CSL-Daily 설명 보기

CSL-Daily (Chinese Sign Language Corpus) is a large-scale continuous SLT dataset. It provides both spoken language translations and gloss-level annotations. The topic revolves around people's daily lives (e.g., travel, shopping, medical care), the most likely SLT application scenario. [1] Improving Sign Language Translation with Monolingual Data by Sign Back-Translation, CVPR, 2021.

관련 논문 63편

Emotional Speech Database

ESD
ESD 설명 보기

ESD is an Emotional Speech Database for voice conversion research. The ESD database consists of 350 parallel utterances spoken by 10 native English and 10 native Chinese speakers and covers 5 emotion categories (neutral, happy, angry, sad and surprise). More than 29 hours of speech data were recorded in a controlled acoustic environment. The database is suitable for multi-speaker and cross-lingual emotional voice conversion studies.

관련 논문 63편

LRS3-TED

LRS3-TED 설명 보기

LRS3-TED is a multi-modal dataset for visual and audio-visual speech recognition. It includes face tracks from over 400 hours of TED and TEDx videos, along with the corresponding subtitles and word alignment boundaries. The new dataset is substantially larger in scale compared to other public datasets that are available for general research. Source: LRS3-TED: a large-scale dataset for visual speech recognition

관련 논문 63편

Localized Narratives

Localized Narratives 설명 보기

We propose Localized Narratives, a new form of multimodal image annotations connecting vision and language. We ask annotators to describe an image with their voice while simultaneously hovering their mouse over the region they are describing. Since the voice and the mouse pointer are synchronized, we can localize every single word in the description. This dense visual grounding takes the form of a mouse trace segment per word and is unique to our data. We annotated 849k images with Localized Narratives: the whole COCO, Flickr30k, and ADE20K datasets, and 671k images of Open Images, all of which we make publicly available. We provide an extensive analysis of these annotations showing they are diverse, accurate, and efficient to produce. We also demonstrate their utility on the application of controlled image captioning.

관련 논문 63편

Social Bias Inference Corpus

SBIC
SBIC 설명 보기

To support large-scale modelling and evaluation with 150k structured annotations of social media posts, covering over 34k implications about a thousand demographic groups. Source: Social Bias Frames: Reasoning about Social and Power Implications of Language

관련 논문 63편

ScanRefer Dataset

ScanRefer Dataset 설명 보기

Contains 51,583 descriptions of 11,046 objects from 800 ScanNet scenes. ScanRefer is the first large-scale effort to perform object localization via natural language expression directly in 3D. Source: ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language

관련 논문 63편

SceneNN

SceneNN 설명 보기

SceneNN is an RGB-D scene dataset consisting of more than 100 indoor scenes. The scenes are captured at various places, e.g., offices, dormitory, classrooms, pantry, etc., from University of Massachusetts Boston and Singapore University of Technology and Design. All scenes are reconstructed into triangle meshes and have per-vertex and per-pixel annotation. The dataset is additionally enriched with fine-grained information such as axis-aligned bounding boxes, oriented bounding boxes, and object poses. Source: SceneNN: A Scene Meshes Dataset with aNNotations Image Source: http://103.24.77.34/scenenn/home/