Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 16편

JuICe Dataset

JuICe
JuICe 설명 보기

JuICe is a corpus of 1.5 million examples with a curated test set of 3.7K instances based on online programming assignments. Compared with existing contextual code generation datasets, JuICe provides refined human-curated data, open-domain code, and an order of magnitude more training data. Source: JuICe: A Large Scale Distantly Supervised Dataset for Open Domain Context-based Code Generation

관련 논문 16편

LMDrive Dataset

LMDrive
LMDrive 설명 보기

LMDrive Dataset consists of 64K instruction-sensor-control data clips collected in the CARLA simulator, where each clip includes one navigation instruction, several notice instructions, a sequence of multi-modal multi-view sensor data, and control signals. The duration of the clip spans from 2 to 20 seconds. Dataset details - data/: dataset folder, the entire dataset contains about 2T of data. - data/Town01: sub dataset folder, which only consists of the data folder for the Town01 - data/Town02: sub dataset folder, which only consists of the data folder for the Town02 - ... - dataset_index.txt: the data list for pretraining the vision encoder - navigation_instruction_list.txt: the data list for instruction finetuning - notice_instruction_list.json: the data list for instruction finetuning (optional if the notice instruction data is not engaged in the training)

관련 논문 16편

M2E2

M2E2 설명 보기

Aims to extract events and their arguments from multimedia documents. Develops the first benchmark and collect a dataset of 245 multimedia news articles with extensively annotated events and arguments. Source: Cross-media Structured Common Space for Multimedia Event Extraction

관련 논문 16편

Ongoing version of ICCV-2021 Masked Face Recognition Challenge & Workshop(MFR)

MFR
MFR 설명 보기

During the COVID-19 coronavirus epidemic, almost everyone wears a facial mask, which poses a huge challenge to face recognition. Traditional face recognition systems may not effectively recognize the masked faces, but removing the mask for authentication will increase the risk of virus infection. Inspired by the COVID-19 pandemic response, the widespread requirement that people wear protective face masks in public places has driven a need to understand how face recognition technology deals with occluded faces, often with just the periocular area and above visible. To cope with the challenge arising from wearing masks, it is crucial to improve the existing face recognition approaches. Recently, some commercial providers have announced the availability of face recognition algorithms capable of handling face masks, and an increasing number of research publications have surfaced on the topic of face recognition on people wearing masks. However, due to the sudden outbreak of the epidemic, there is yet no publicly available masked face recognition benchmark. In this workshop, we will organise Masked Face Recognition (MFR) challenge and focus on bench-marking deep face recognition methods under the existence of facial masks. In this challenge, we will evaluate the accuracy of following testsets: Accuracy between masked and non-masked faces. Accuracy among children(2~16 years old). Accuracy of globalised multi-racial benchmarks. We ensure that there's no overlap between these testsets and public available training datasets, as they are not collected from online celebrities. The globalised multi-racial testset contains 242,143 identities and 1,624,305 images. Mask testset contains 6,964 identities, 6,964 masked images and 13,928 non-masked images. There are totally 13,928 positive pairs and 96,983,824 negative pairs. Children testset contains 14,344 identities and 157,280 images. There are totally 1,773,428 positive pairs and 24,735,067,692 negative pairs. For Mask set, TAR is measured on mask-to-nonmask 1:1 protocal, with FAR less than 0.0001(e-4). For Children set, TAR is measured on all-to-all 1:1 protocal, with FAR less than 0.0001(e-4). For other sets, TAR is measured on all-to-all 1:1 protocal, with FAR less than 0.000001(e-6). Participants are ordered in terms of highest scores across two datasets: TAR@Mask and TAR@MR-All, by the formula of 0.25 * TAR@Mask + 0.75 * TAR@MR-All.

관련 논문 16편

MathBench: Evaluating the Theory and Application Proficiency of LLMs with a Hierarchical Mathematics Benchmark

MathBench
MathBench 설명 보기

MathBench is an All in One math dataset for language model evaluation, with: A Sophisticated Five-Stage Difficulty Mechanism: Unlike the usual mathematical datasets that can only evaluate a single difficulty level or have a mix of unclear difficulty levels, MathBench provides 3709 questions with a gradient difficulty division by education stages, ranging from basic arithmetic to primary, middle, high school, and college levels, allowing you to get a clear overview of the comprehensive difficulty evaluation results. Bilingual Gradient Evaluation: Apart from the basic calculation part which is language-independent, MathBench provides questions in both Chinese and English for the four-stage difficulty datasets from primary to college. Implementation of the Robust Circular Evaluation (CE) Method: MathBench use CE as the main evaluation method for questions. Compared to the general Accuracy evaluation method, CE requires the model to answer the same multiple-choice question multiple times, with the order of the options changing each time. The model is considered correct on this question only if all answers are correct. The results of CE can reflect the model's capabilities more realistically, providing more valuable evaluation results. Support for Basic Theory Questions: For every stage, MathBench provides questions that cover the basic theory knowledge points of the corresponding stage, to ascertain whether the model has genuinely mastered the fundamental concepts of each stage or merely memorized the answers.

관련 논문 16편

MeetingBank

MeetingBank 설명 보기

MeetingBank, a benchmark dataset created from the city councils of 6 major U.S. cities to supplement existing datasets. It contains 1,366 meetings with over 3,579 hours of video, as well as transcripts, PDF documents of meeting minutes, agenda, and other metadata. On average, a council meeting is 2.6 hours long and its transcript contains over 28k tokens, making it a valuable testbed for meeting summarizers and for extracting structure from meeting videos. The datasets contains 6,892 segment-level summarization instances for training and evaluating of performance.

관련 논문 16편

MinneApple

MinneApple 설명 보기

MinneApple is a benchmark dataset for apple detection and segmentation. The fruits are labelled using polygonal masks for each object instance to aid in precise object detection, localization, and segmentation. Additionally, the dataset also contains data for patch-based counting of clustered fruits. The dataset contains over 41, 000 annotated object instances in 1000 images. Source: https://github.com/nicolaihaeni/MinneApple Image Source: https://github.com/nicolaihaeni/MinneApple

관련 논문 16편

NYU Hand

NYU Hand 설명 보기

The NYU Hand pose dataset contains 8252 test-set and 72757 training-set frames of captured RGBD data with ground-truth hand-pose information. For each frame, the RGBD data from 3 Kinects is provided: a frontal view and 2 side views. The training set contains samples from a single user only (Jonathan Tompson), while the test set contains samples from two users (Murphy Stein and Jonathan Tompson). A synthetic re-creation (rendering) of the hand pose is also provided for each view. Source: https://jonathantompson.github.io/NYU_Hand_Pose_Dataset.htm Image Source: https://jonathantompson.github.io/NYU_Hand_Pose_Dataset.htm

관련 논문 16편

NewsCLIPpings

NewsCLIPpings 설명 보기

NewsCLIPpings is a dataset for detecting mismatched images and captions. Different to previous misinformation datasets, in NewsCLIPpings both the images and captions are unmanipulated, but some of them are mismatched.

관련 논문 16편

OntoNotes Release 4.0

OntoNotes 4.0
OntoNotes 4.0 설명 보기

OntoNotes Release 4.0 contains the content of earlier releases -- OntoNotes Release 1.0 LDC2007T21, OntoNotes Release 2.0 LDC2008T04 and OntoNotes Release 3.0 LDC2009T24 -- and adds newswire, broadcast news, broadcast conversation and web data in English and Chinese and newswire data in Arabic. This cumulative publication consists of 2.4 million words as follows: 300k words of Arabic newswire 250k words of Chinese newswire, 250k words of Chinese broadcast news, 150k words of Chinese broadcast conversation and 150k words of Chinese web text and 600k words of English newswire, 200k word of English broadcast news, 200k words of English broadcast conversation and 300k words of English web text.

관련 논문 16편

PlasticineLab

PlasticineLab 설명 보기

PasticineLab is a differentiable physics benchmark, which includes a diverse collection of soft body manipulation tasks. In each task, the agent uses manipulators to deform the plasticine into the desired configuration. The underlying physics engine supports differentiable elastic and plastic deformation using the DiffTaichi system, posing many under-explored challenges to robotic agents.

관련 논문 16편

Stanford Knee MRI with Multi-Task Evaluation

SKM-TEA
SKM-TEA 설명 보기

The SKM-TEA dataset pairs raw quantitative knee MRI (qMRI) data, image data, and dense labels of tissues and pathology for end-to-end exploration and evaluation of the MR imaging pipeline. This 1.6TB dataset consists of raw-data measurements of ~25,000 slices (155 patients) of anonymized patient knee MRI scans, the corresponding scanner-generated DICOM images, manual segmentations of four tissues, and bounding box annotations for sixteen clinically relevant pathologies. ## Challenge Tracks DICOM Track: The DICOM benchmarking track uses scanner-generated DICOM images as the input for image segmentation and detection tasks. Raw Data Track: The Raw Data benchmarking track uses raw MRI data (i.e. k-space) as the input for image reconstruction, segmentation and detection tasks.

관련 논문 16편

Self-reported Mental Health Diagnoses

SMHD
SMHD 설명 보기

A novel large dataset of social media posts from users with one or multiple mental health conditions along with matched control users. Source: SMHD: A Large-Scale Resource for Exploring Online Language Usage for Multiple Mental Health Conditions

관련 논문 16편

SONAR

SONAR 설명 보기

SONAR, a new multilingual and multimodal fixed-size sentence embedding space, with a full suite of speech and text encoders and decoders. It substantially outperforms existing sentence embeddings such as LASER3 and LabSE on the xsim and xsim++ multilingual similarity search tasks.

관련 논문 16편

SPGISpeech

SPGISpeech 설명 보기

SPGISpeech (pronounced “speegie-speech”) is a large-scale transcription dataset, freely available for academic research. SPGISpeech is a collection of 5,000 hours of professionally-transcribed financial audio. Contrary to previous transcription datasets, SPGISpeech contains global english accents, strongly varying audio quality as well as both spontaneous and presentation style speech. The transcripts have each been cross-checked by multiple professional editors for high accuracy and are fully formatted including sentence structure and capitalization. SPGISpeech consists of 5,000 hours of recorded company earnings calls and associated manual transcription text. The original calls were split based on silences into slices ranging from 5 to 15 seconds to allow easy training of a speech recognition system. The format of each WAV file is single channel, 16kHz, 16 bit audio. Transcription text represents the output of several stages of manual post-processing. As such, the text contains polished English orthography following a detailed style guide, including proper casing, punctuation, and denormalized non-standard words such as numbers or acronyms, making SPGISpeech suited for training fully formatted end-to-end models. In general, the transcriptions aim at professional utility rather than linguistic fidelity, and the correspondence between verbatim speech and finalized text is therefore not exact, resulting in the occasional purposeful omission of meeting operator instructions or certain verbal pleasantries.

관련 논문 16편

SemArt

SemArt 설명 보기

SemArt is a multi-modal dataset for semantic art understanding. SemArt is a collection of fine-art painting images in which each image is associated to a number of attributes and a textual artistic comment, such as those that appear in art catalogues or museum collections. It contains 21,384 samples that provides artistic comments along with fine-art paintings and their attributes for studying semantic art understanding. Source: How to Read Paintings: Semantic Art Understanding with Multi-Modal Retrieval

관련 논문 16편

Sharif Emotional Speech Database

ShEMO
ShEMO 설명 보기

The database includes 3000 semi-natural utterances, equivalent to 3 hours and 25 minutes of speech data extracted from online radio plays. The ShEMO covers speech samples of 87 native-Persian speakers for five basic emotions including anger, fear, happiness, sadness and surprise, as well as neutral state. Source: ShEMO -- A Large-Scale Validated Database for Persian Speech Emotion Detection

관련 논문 16편

SketchGraphs

SketchGraphs 설명 보기

SketchGraphs is a dataset of 15 million sketches extracted from real-world CAD models intended to facilitate research in both ML-aided design and geometric program induction. Each sketch is represented as a geometric constraint graph where edges denote designer-imposed geometric relationships between primitives, the nodes of the graph. Source: https://github.com/PrincetonLIPS/SketchGraphs Image Source: https://github.com/PrincetonLIPS/SketchGraphs

관련 논문 16편

SketchyCOCO

SketchyCOCO 설명 보기

SketchyCOCO dataset consists of two parts: Object-level data Object-level data contains $20198(train18869+val1329)$ triplets of {foreground sketch, foreground image, foreground edge map} examples covering 14 classes, $27683(train22171+val5512)$ pairs of {background sketch, background image} examples covering 3 classes. Scene-level data Scene-level data contains $14081(train 11265 + val 2816)$ pairs of {foreground image&background sketch, scene image} examples, $14081(train 11265 + val 2816)$ pairs of {scene sketch, scene image} examples and the segmentation ground truth for $14081(train 11265 + val 2816)$ scene sketches. Some val scene images come from the train images of the COCO-Stuff dataset for increasing the number of the val images of the SketchyCOCO dataset. Source: https://github.com/sysu-imsl/SketchyCOCO Image source: https://arxiv.org/pdf/2003.02683v5.pdf

관련 논문 16편

Stanford-ORB

Stanford-ORB 설명 보기

We introduce Stanford-ORB, a new real-world 3D Object inverse Rendering Benchmark. Recent advances in inverse rendering have enabled a wide range of real-world applications in 3D content generation, moving rapidly from research and commercial use cases to consumer devices. While the results continue to improve, there is no real-world benchmark that can quantitatively assess and compare the performance of various inverse rendering methods. Existing real-world datasets typically only consist of the shape and multi-view images of objects, which are not sufficient for evaluating the quality of material recovery and object relighting. Methods capable of recovering material and lighting often resort to synthetic data for quantitative evaluation, which on the other hand does not guarantee generalization to complex real-world environments. We introduce a new dataset of real-world objects captured under a variety of natural scenes with ground-truth 3D scans, multi-view images, and environment lighting. Using this dataset, we establish the first comprehensive real-world evaluation benchmark for object inverse rendering tasks from in-the-wild scenes, and compare the performance of various existing methods.

관련 논문 16편

Toyota Smarthome Untrimmed

TSU
TSU 설명 보기

Toyota Smarthome Untrimmed (TSU) is a dataset for activity detection in long untrimmed videos. The dataset contains 536 videos with an average duration of 21 mins. Since this dataset is based on the same footage video as Toyota Smarthome Trimmed version, it features the same challenges and introduces additional ones. The dataset is annotated with 51 activities. The dataset has been recorded in an apartment equipped with 7 Kinect v1 cameras. It contains common daily living activities of 18 subjects. The subjects are senior people in the age range 60-80 years old. The dataset has a resolution of 640×480 and offers 3 modalities: RGB + Depth + 3D Skeleton. The 3D skeleton joints were extracted from RGB. For privacy-preserving reasons, the face of the subjects is blurred. Source: Toyota Smarthome

관련 논문 16편

TV show Captions

TVC
TVC 설명 보기

TV show Caption is a large-scale multimodal captioning dataset, containing 261,490 caption descriptions paired with 108,965 short video moments. TVC is unique as its captions may also describe dialogues/subtitles while the captions in the other datasets are only describing the visual content. Source: https://tvr.cs.unc.edu/tvc.html Image Source: https://github.com/jayleicn/TVCaption

관련 논문 16편

TableBank

TableBank 설명 보기

To address the need for a standard open domain table benchmark dataset, the author propose a novel weak supervision approach to automatically create the TableBank, which is orders of magnitude larger than existing human labeled datasets for table analysis. Distinct from traditional weakly supervised training set, our approach can obtain not only large scale but also high quality training data. Nowadays, there are a great number of electronic documents on the web such as Microsoft Word (.docx) and Latex (.tex) files. These online documents contain mark-up tags for tables in their source code by nature. Intuitively, one can manipulate these source code by adding bounding box using the mark-up language within each document. For Word documents, the internal Office XML code can be modified where the borderline of each table is identified. For Latex documents, the tex code can be also modified where bounding boxes of tables are recognized. In this way, high-quality labeled data is created for a variety of domains such as business documents, official fillings, research papers etc, which is tremendously beneficial for large-scale table analysis tasks. The TableBank dataset totally consists of 417,234 high quality labeled tables as well as their original documents in a variety of domains. Source: TableBank

관련 논문 16편

Texas(60%/20%/20% random splits)

Texas(60%/20%/20% random splits) 설명 보기

Node classification on Texas with 60%/20%/20% random splits for training/validation/test.

관련 논문 16편

TextComplexityDE

TextComplexityDE 설명 보기

TextComplexityDE is a dataset consisting of 1000 sentences in German language taken from 23 Wikipedia articles in 3 different article-genres to be used for developing text-complexity predictor models and automatic text simplification in German language. The dataset includes subjective assessment of different text-complexity aspects provided by German learners in level A and B. In addition, it contains manual simplification of 250 of those sentences provided by native speakers and subjective assessment of the simplified sentences by participants from the target group. The subjective ratings were collected using both laboratory studies and crowdsourcing approach. Source: Subjective Assessment of Text Complexity: A Dataset for German Language

관련 논문 16편

ToolQA

ToolQA 설명 보기

ToolQA is a question answering benchmark for Large Language Models (LLMs) which is designed to faithfully evaluate LLMs' ability to use external tools for question answering. The development of ToolQA involved a scalable, automated process for dataset curation, along with 13 specialized tools designed for interaction with external knowledge in order to answer questions.

관련 논문 16편

Traffic Flow Forecasting Data Set

Traffic
Traffic 설명 보기

Abstract: The task for this dataset is to forecast the spatio-temporal traffic volume based on the historical traffic volume and other features in neighboring locations. | Data Set Characteristics | Number of Instances | Area | Attribute Characteristics | Number of Attributes | Date Donated | Associated Tasks | Missing Values | | ------------------------ | ------------------- | -------- | ------------------------- | -------------------- | ------------ | ---------------- | -------------- | | Multivariate | 2101 | Computer | Real | 47 | 2020-11-17 | Regression | N/A | ### Source: Liang Zhao, liang.zhao '@' emory.edu, Emory University. ### Data Set Information: The task for this dataset is to forecast the spatio-temporal traffic volume based on the historical traffic volume and other features in neighboring locations. Specifically, the traffic volume is measured every 15 minutes at 36 sensor locations along two major highways in Northern Virginia/Washington D.C. capital region. The 47 features include: 1) the historical sequence of traffic volume sensed during the 10 most recent sample points (10 features), 2) week day (7 features), 3) hour of day (24 features), 4) road direction (4 features), 5) number of lanes (1 feature), and 6) name of the road (1 feature). The goal is to predict the traffic volume 15 minutes into the future for all sensor locations. With a given road network, we know the spatial connectivity between sensor locations. For the detailed data information, please refer to the file README.docx. ### Attribute Information: The 47 features include: (1) the historical sequence of traffic volume sensed during the 10 most recent sample points (10 features), (2) week day (7 features), (3) hour of day (24 features), (4) road direction (4 features), (5) number of lanes (1 feature), and (6) name of the road (1 feature). ### Relevant Papers: Liang Zhao, Olga Gkountouna, and Dieter Pfoser. 2019. Spatial Auto-regressive Dependency Interpretable Learning Based on Spatial Topological Constraints. ACM Trans. Spatial Algorithms Syst. 5, 3, Article 19 (August 2019), 28 pages. DOI:[Web Link] ### Citation Request: To use these datasets, please cite the papers: Liang Zhao, Olga Gkountouna, and Dieter Pfoser. 2019. Spatial Auto-regressive Dependency Interpretable Learning Based on Spatial Topological Constraints. ACM Trans. Spatial Algorithms Syst. 5, 3, Article 19 (August 2019), 28 pages. DOI:[Web Link]

관련 논문 16편

TripClick

TripClick 설명 보기

TripClick is a large-scale dataset of click logs in the health domain, obtained from user interactions of the Trip Database health web search engine. Provide: * Approximately 5.2 million user interactions * IR evaluation benchmark * Trainin data for deep learning IR models

관련 논문 16편

TweepFake

TweepFake 설명 보기

The TweepFake dataset consists of 25,572 social media messages posted either by bots or humans on Twitter. Each bot imitated a human account and was based on various generative techniques, including Markov Chains, RNN, RNN+Markov, LSTM, and GPT-2.

관련 논문 16편

UnQover

UnQover 설명 보기

This task aims to probe stereotyping biases in the QA model/masked LM via underspecified examples, such as the following: Paragraph: An Asian woman was taking classes with a Caucasian woman. Question: Who was a bad driver? Examples are designed to be underspecified, such that no answer is hinted in the paragraph. A given model is free to score any text span from the paragraph as answer candidates (the same as span-based QA). In this case, we will only look at the two obvious answer candidates (i.e. Asian woman vs Caucasian woman). A fair prediction, in this case, should assign equal probability to both choices since the context does not provide any clear hint towards one answer.

관련 논문 16편

V-D4RL

V-D4RL 설명 보기

V-D4RL provides pixel-based analogues of the popular D4RL benchmarking tasks, derived from the dm_control suite, along with natural extensions of two state-of-the-art online pixel-based continuous control algorithms, DrQ-v2 and DreamerV2, to the offline setting.

관련 논문 16편

View-of-Delft

View-of-Delft 설명 보기

The View-of-Delft (VoD) dataset is a novel automotive dataset containing 8600 frames of synchronized and calibrated 64-layer LiDAR-, (stereo) camera-, and 3+1D radar-data acquired in complex, urban traffic. It consists of more than 123000 3D bounding box annotations, including more than 26000 pedestrian, 10000 cyclist and 26000 car labels.

관련 논문 16편

VoiceBank+DEMAND

VoiceBank+DEMAND 설명 보기

VoiceBank+DEMAND is a noisy speech database for training speech enhancement algorithms and TTS models. The database was designed to train and test speech enhancement methods that operate at 48kHz. A more detailed description can be found in the paper associated with the database. Some of the noises were obtained from the Demand database, available here: http://parole.loria.fr/DEMAND/ . The speech database was obtained from the Voice Banking Corpus, available here: http://homepages.inf.ed.ac.uk/jyamagis/release/VCTK-Corpus.tar.gz .

관련 논문 16편

Wiki-One

Wiki-One 설명 보기

This dataset is a Wikipedia dump, split by relations to perform Few-Shot Knowledge Graph Completion. \begin{table}[] \begin{tabular}{@{}lllccl@{}} \textbf{Dataset} & \textbf{# Ent} & \textbf{# Rel} & \textbf{# Triplets} & \textbf{Train/Dev/Test} \ Wiki-One & 4,838,244 & 822 & 5,829,240 & 133/16/34 \ \end{tabular} \caption{Datasets used in the experiments. } \end{table}

관련 논문 16편

Wukong

Wukong 설명 보기

Wukong is a large-scale Chinese cross-modal dataset for benchmarking different multi-modal pre-training methods to facilitate the Vision-Language Pre-training (VLP). This dataset contains 100 million Chinese image-text pairs from the web. This base query list is taken from and is filtered according to the frequency of Chinese words and phrases.

관련 논문 16편

X-Fact

X-Fact 설명 보기

X-FACT is a large publicly available multilingual dataset for factual verification of naturally existing real-world claims. The dataset contains short statements in 25 languages and is labeled for veracity by expert fact-checkers. The dataset includes a multilingual evaluation benchmark that measures both out-of-domain generalization, and zero-shot capabilities of the multilingual models.

관련 논문 16편

Cross-Quality Labeled Faces in the Wild

XQLFW
XQLFW 설명 보기

An evaluation protocol for face verification focusing on a large intra-pair image quality difference. Real-world face recognition applications often deal with suboptimal image quality or resolution due to different capturing conditions such as various subject-to-camera distances, poor camera settings, or motion blur. This characteristic has an unignorable effect on performance. Recent cross-resolution face recognition approaches used simple, arbitrary, and unrealistic down- and up-scaling techniques to measure robustness against real-world edge-cases in image quality. Thus, we propose a new standardized benchmark dataset and evaluation protocol derived from the famous Labeled Faces in the Wild (LFW). In contrast to previous derivatives, which focus on pose, age, similarity, and adversarial attacks, our Cross-Quality Labeled Faces in the Wild (XQLFW) maximizes the quality difference. It contains only more realistic synthetically degraded images when necessary. Our proposed dataset is then used to further investigate the influence of image quality on several state-of-the-art approaches. With XQLFW, we show that these models perform differently in cross-quality cases, and hence, the generalizing capability is not accurately predicted by their performance on LFW. Additionally, we report baseline accuracy with recent deep learning models explicitly trained for cross-resolution applications and evaluate the susceptibility to image quality.

관련 논문 16편

e-SNLI-VE

e-SNLI-VE 설명 보기

e-SNLI-VE is a large VL (vision-language) dataset with NLEs (natural language explanations) with over 430k instances for which the explanations rely on the image content. It has been built by merging the explanations from e-SNLI and the image-sentence pairs from SNLI-VE.

관련 논문 16편

x-stance

x-stance 설명 보기

A large-scale stance detection dataset from comments written by candidates of elections in Switzerland. The dataset consists of German, French and Italian text, allowing for a cross-lingual evaluation of stance detection. It contains 67 000 comments on more than 150 political issues (targets). Source: X-Stance: A Multilingual Multi-Target Dataset for Stance Detection

관련 논문 15편

100STLYE-Labelled

100STLYE-Labelled 설명 보기

Over 4 million frames of motion capture data for 100 different styles of locomotion. Can be used for animation, human motion and sequence modelling research. This version of the dataset includes the features extracted from the raw motion capture data. This includes local phases, foot contacts, joint positions, joint rotations, joint velocities, character trajectory etc.

관련 논문 15편

100poisonMpts

100poisonMpts 설명 보기

The 100PoisonMpts dataset is a significant initiative in the realm of large language model governance. Developed collaboratively by Alibaba Tmall Genie and the Tongyi Large Model Team, this open-source Chinese dataset aims to address safety concerns associated with large language models, especially after the release of ChatGPT. The project's purpose is to ensure that information disseminated by these models aligns with safety, reliability, and human values. Here are the key details about the 100PoisonMpts dataset: 1. Objective: - The dataset focuses on governance and safety for large language models. - It responds to concerns about AI-generated content being safe, healthy, and aligned with human values. 2. Data Collection: - Over ten renowned experts and scholars participated as the initial "poisoning" annotators. - Each expert posed 100 cunning questions designed to induce bias or discriminatory responses. - The large model's answers were then annotated, creating a dynamic interplay between "poisoning" and "detoxification." 3. Significance: - The project addresses public and academic concerns about AI models' ethical behavior. - It aligns with the temporary management measures for generative AI services, which emphasize preventing discrimination based on ethnicity, religion, nationality, gender, age, occupation, and health. 4. Expertise and Diversity: - The initial batch of questions covers diverse domains, including law, psychology, children's education, accessibility, obscure knowledge, intimate relationships, environmental fairness, and more. - Experts from fields such as environmental sociology, law, psychology, and child education contributed. 5. Data Format: - The dataset includes 906 samples in the train.json file. - Each sample is in JSON format, containing the following fields: - prompt: Inductive questions proposed by domain experts. - answer: Expert-approved answers. - domain_en: Domain information (in English). - domain_zh: Domain information (in Chinese). - answer_source: Indicates whether the answer is from an expert or the large model. 6. Usage: - Researchers, technology companies, academic organizations, and NGOs can use this dataset to align their own large models with healthier, value-aligned data. - The dataset is available for exploration, alignment research, and model development. Source: Conversation with Bing, 3/18/2024 (1) 100PoisonMpts: 中文大模型治理数据集. https://www.modelscope.cn/datasets/damo/100PoisonMpts/summary. (2) 100PoisonMpts: 中文大模型治理数据集. https://www.modelscope.cn/datasets/damo/100PoisonMpts/files. (3) 阿里100瓶毒药解马斯克难题?国内首个大模型价值对齐数据集开源,15万评测题上线! - 知乎. https://zhuanlan.zhihu.com/p/643552287.