Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 15편

Kolektor Surface-Defect Dataset 2

KolektorSDD2
KolektorSDD2 설명 보기

KolektorSDD2 is a surface-defect detection dataset with over 3000 images containing several types of defects, obtained while addressing a real-world industrial problem. The dataset consists of: * 356 images with visible defects * 2979 images without any defect * image sizes of approximately 230 x 630 pixels * train set with 246 positive and 2085 negative images * test set with 110 positive and 894 negative images * several different types of defects (scratches, minor spots, surface imperfections, etc.)

관련 논문 15편

LIVE-FB Large-Scale Social Video Quality (LSVQ) Database

LIVE-FB LSVQ
LIVE-FB LSVQ 설명 보기

No-reference (NR) perceptual video quality assessment (VQA) is a complex, unsolved, and important problem to social and streaming media applications. Efficient and accurate video quality predictors are needed to monitor and guide the processing of billions of shared, often imperfect, user-generated content (UGC). Unfortunately, current NR models are limited in their prediction capabilities on real-world, "in-the-wild" UGC video data. To advance progress on this problem, we created the largest (by far) subjective video quality dataset, containing 39, 000 real-world distorted videos and 117, 000 space-time localized video patches ("v-patches"), and 5.5M human perceptual quality annotations. Using this, we created two unique NR-VQA models: (a) a local-to-global region-based NR VQA architecture (called PVQ) that learns to predict global video quality and achieves state-of-the-art performance on 3 UGC datasets, and (b) a first-of-a-kind space-time video quality mapping engine (called PVQ Mapper) that helps localize and visualize perceptual distortions in space and time. We will make the new database and prediction models available immediately following the review process.

관련 논문 15편

More Inclusive Annotations for People

MIAP
MIAP 설명 보기

MIAP is a dataset created by obtaining a new set of annotations on a subset of the Open Images dataset, containing bounding boxes and attributes for all of the people visible in those images, as the original Open Images dataset annotations are not exhaustive, with bounding boxes and attribute labels for only a subset of the classes in each image. The MIAP dataset focuses on enabling ML Fairness research. It provides additional annotations for 100,000 (70k from training and 30k from validation/test) images that contain at least one person bounding box in the original annotations. These additional annotations provide exhaustive bounding boxes for all people in an image. Person boxes are further annotated with attribute labels for fairness research. Annotated attributes include the human perceived gender presentation (predominantly feminine, predominantly masculine, and unknown) and perceived age range (young, middle, older, and unknown) of the localized person. This procedure adds nearly 100,000 new boxes that were not annotated under the original labeling pipeline. Annotations on the exhaustive set enable research into the fairness properties of models trained on partial annotations and the pipelines that produce these annotations.

관련 논문 15편

Multimodal Hate Speech

MMHS150k
MMHS150k 설명 보기

Existing hate speech datasets contain only textual data. We create a new manually annotated multimodal hate speech dataset formed by 150,000 tweets, each one of them containing text and an image. We call the dataset MMHS150K.

관련 논문 15편

MSRA Hand

MSRA Hand 설명 보기

MSRA Hands is a dataset for hand tracking. In total 6 subjects' right hands are captured using Intel's Creative Interactive Gesture Camera. Each subject is asked to make various rapid gestures in a 400-frame video sequence. To account for different hand sizes, a global hand model scale is specified for each subject: 1.1, 1.0, 0.9, 0.95, 1.1, 1.0 for subject 1~6, respectively. The camera intrinsic parameters are: principle point = image center(160, 120), focal length = 241.42. The depth image is 320x240, each .bin file stores the depth pixel values in row scanning order, which are 320240 floats. The unit is millimeters. The bin file is binary and needs to be opened with std::ios::binary flag. joint.txt file stores 400 frames x 21 hand joints per frame. Each line has 3 * 21 = 63 floats for 21 3D points in (x, y, z) coordinates. The 21 hand joints are: wrist, index_mcp, index_pip, index_dip, index_tip, middle_mcp, middle_pip, middle_dip, middle_tip, ring_mcp, ring_pip, ring_dip, ring_tip, little_mcp, little_pip, little_dip, little_tip, thumb_mcp, thumb_pip, thumb_dip, thumb_tip. The corresponding *.jpg file is just for visualization of depth and ground truth joints. Source: https://jimmysuen.github.io/txt/cvpr14_MSRAHandTrackingDB_readme.txt Image Source: https://www.cv-foundation.org/openaccess/content_cvpr_2014/papers/Qian_Realtime_and_Robust_2014_CVPR_paper.pdf

관련 논문 15편

MaSS

MaSS 설명 보기

MaSS (Multilingual corpus of Sentence-aligned Spoken utterances) is an extension of the CMU Wilderness Multilingual Speech Dataset, a speech dataset based on recorded readings of the New Testament. MaSS extends it by providing a large and clean dataset of 8,130 parallel spoken utterances across 8 languages (56 language pairs). The covered languages are: Basque, English, Finnish, French, Hungarian, Romanian, Russian and Spanish. Source: MaSS: A Large and Clean Multilingual Corpus of Sentence-aligned Spoken Utterances Extracted from the Bible Image Source: https://arxiv.org/pdf/1907.12895v3.pdf

관련 논문 15편

Medical Video Question Answering

MedVidQA
MedVidQA 설명 보기

The MedVidQA dataset contains the collection of 3, 010 manually created health-related questions and timestamps as visual answers to those questions from trusted video sources, such as accredited medical schools with an established reputation, health institutes, health education, and medical practitioners.

관련 논문 15편

Montreal Archive of Sleep Studies

Montreal Archive of Sleep Studies 설명 보기

The Montreal Archive of Sleep Studies (MASS) is an open-access and collaborative database of laboratory-based polysomnography (PSG) recordings O’Reilly, C., et al. (2014) J Seep Res, 23(6):628-635. Its goal is to provide a standard and easily accessible source of data for benchmarking the various systems developed to help the automation of sleep analysis. It also provides a readily available source of data for fast validation of experimental results and for exploratory analyses. Finally, it is a shared resource that can be used to foster large-scale collaborations in sleep studies. MASS is composed of cohorts themselves comprising subsets. Recordings within subsets is kept as homogeneous as possible, whereas it is more heterogeneous between subsets. To allow inter-study comparisons, researchers validating their results on MASS are encouraged to specify which portion of the database they used in their assessment (e.g., MASS-C1 for the whole cohort 1, MASS-C1/SS1-SS3 for subsets 1, 2 and 3 of cohort 1). Currently, the first MASS cohort available is described in O’Reilly, C., et al. (2014) J Seep Res, 23(6):628-635. This cohort comprises polysomnograms of 200 complete nights recorded in 97 men and 103 women of age varying between 18 and 76 years (mean: 38.3 years, SD: 18.9 years). It has been split into five different subsets. Source: Montreal Archive of Sleep Studies: an open-access resource for instrument benchmarking and exploratory research

관련 논문 15편

Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correction

MuCGEC
MuCGEC 설명 보기

MuCGEC is a multi-reference multi-source evaluation dataset for Chinese Grammatical Error Correction (CGEC), consisting of 7,063 sentences collected from three different Chinese-as-a-Second-Language (CSL) learner sources. Each sentence has been corrected by three annotators, and their corrections are meticulously reviewed by an expert, resulting in 2.3 references per sentence.

관련 논문 15편

Large-Scale Dataset for Event-Based Object Recognition

N-ImageNet
N-ImageNet 설명 보기

The N-ImageNet dataset is an event-camera counterpart for the ImageNet dataset. The dataset is obtained by moving an event camera around a monitor displaying images from ImageNet. N-ImageNet contains approximately 1,300k training samples and 50k validation samples. In addition, the dataset also contains variants of the validation dataset recorded under a wide range of lighting or camera trajectories. Additional details about the dataset are explained in the paper available through this link. Please cite this paper if you make use of the dataset.

관련 논문 15편

NYT11-HRL

NYT11-HRL 설명 보기

Preprocessed version of NYT11. Each relational triple is formatted as follows: rtext : relation type em1 : source entity mention em2 : target entity mention tags : the proposed entity annotation scheme for the sentence 0 : $O$ non-entity 1 : $S_I$ inside of a source entity 2 : $T_I$ inside of a target entity 3 : $O_I$ inside of not-concerned entity 4 : $S_B$ begin of a source entity 5 : $T_B$ begin of a target entity 6 : $O_B$ begin of not-concerned entity

관련 논문 15편

Optical Coherence Tomography Image Retinal Database

OCTID
OCTID 설명 보기

An open-source Optical Coherence Tomography Image Database containing different retinal OCT images with various pathological conditions. This comprehensive open-access database contains over 500 high-resolution images categorized into different pathological conditions. The image classes include Normal (NO), Macular Hole (MH), Age-related Macular Degeneration (AMD), Central Serous Retinopathy (CSR), and Diabetic Retinopathy (DR).

관련 논문 15편

OpenASL

OpenASL 설명 보기

Large-scale American Sign Language (ASL) - English dataset collected from online video sites (e.g., YouTube). OpenASL contains 288 hours of ASL videos in multiple domains from over 200 signers.

관련 논문 15편

Opusparcus

Opusparcus 설명 보기

Opusparcus is a paraphrase corpus for six European languages: German, English, Finnish, French, Russian, and Swedish. The paraphrases are extracted from the OpenSubtitles2016 corpus, which contains subtitles from movies and TV shows. For each target language, the Opusparcus data have been partitioned into three types of data sets: training, development and test sets. The training sets are large, consisting of millions of sentence pairs, and have been compiled automatically, with the help of probabilistic ranking functions. The development and test sets consist of sentence pairs that have been annotated manually; each set contains approximately 1000 sentence pairs that have been verified to be acceptable paraphrases by two annotators. Source: Opusparcus

관련 논문 15편

PANDA

PANDA 설명 보기

PANDA is the first gigaPixel-level humAN-centric viDeo dAtaset, for large-scale, long-term, and multi-object visual analysis. The videos in PANDA were captured by a gigapixel camera and cover real-world scenes with both wide field-of-view (~1 square kilometer area) and high-resolution details (~gigapixel-level/frame). The scenes may contain 4k head counts with over 100x scale variation. PANDA provides enriched and hierarchical ground-truth annotations, including 15,974.6k bounding boxes, 111.8k fine-grained attribute labels, 12.7k trajectories, 2.2k groups and 2.9k interactions. Source: PANDA: A Gigapixel-level Human-centric Video Dataset

관련 논문 15편

Paris-Lille-3D

Paris-Lille-3D 설명 보기

The Paris-Lille-3D is a Benchmark on Point Cloud Classification. The Point Cloud has been labeled entirely by hand with 50 different classes. The dataset consists of around 2km of Mobile Laser System point cloud acquired in two cities in France (Paris and Lille). Source: Paris-Lille-3D: a large and high-quality ground truth urban point cloud dataset for automatic segmentation and classification Image Source: https://npm3d.fr/paris-lille-3d

관련 논문 15편

PointOdyssey

PointOdyssey 설명 보기

PointOdyssey is a large-scale synthetic dataset, and data generation framework, for the training and evaluation of long-term fine-grained tracking algorithms. The dataset currently includes 104 videos, averaging 2,000 frames long, with orders of magnitude more correspondence annotations than prior work.

관련 논문 15편

Project CodeNet

Project CodeNet 설명 보기

Project CodeNet is a large-scale dataset with approximately 14 million code samples, each of which is an intended solution to one of 4000 coding problems. The code samples are written in over 50 programming languages (although the dominant languages are C++, C, Python, and Java) and they are annotated with a rich set of information, such as its code size, memory footprint, cpu run time, and status, which indicates acceptance or error types. The dataset is accompanied by a repository, where we provide a set of tools to aggregate codes samples based on user criteria and to transform code samples into token sequences, simplified parse trees and other code graphs. A detailed discussion of Project CodeNet is available in this paper. The rich annotation of Project CodeNet enables research in code search, code completion, code-code translation, and a myriad of other use cases. We also extracted several benchmarks in Python, Java and C++ to drive innovation in deep learning and machine learning models in code classification and code similarity. #### Citation @inproceedings{puri2021codenet, author = {Ruchir Puri and David Kung and Geert Janssen and Wei Zhang and Giacomo Domeniconi and Vladmir Zolotov and Julian Dolby and Jie Chen and Mihir Choudhury and Lindsey Decker and Veronika Thost and Luca Buratti and Saurabh Pujar and Ulrich Finkler}, title = {Project CodeNet: A Large-Scale AI for Code Dataset for Learning a Diversity of Coding Tasks}, year = {2021}, } Source: Project CodeNet

관련 논문 15편

PubMed (48%/32%/20% fixed splits)

PubMed (48%/32%/20% fixed splits) 설명 보기

Node classification on PubMed with the fixed 48%/32%/20% splits provided by Geom-GCN.

관련 논문 15편

PubMed Tables One Million

PubTables-1M
PubTables-1M 설명 보기

The goal of PubTables-1M is to create a large, detailed, high-quality dataset for training and evaluating a wide variety of models for the tasks of table detection, table structure recognition, and functional analysis. It contains: - 460,589 annotated document pages containing tables for table detection. - 947,642 fully annotated tables including text content and complete location (bounding box) information for table structure recognition and functional analysis. - Full bounding boxes in both image and PDF coordinates for all table rows, columns, and cells (including blank cells), as well as other annotated structures such as column headers and projected row headers. - Rendered images of all tables and pages. - Bounding boxes and text for all words appearing in each table and page image. - Additional cell properties not used in the current model training. Additionally, cells in the headers are canonicalized and we implement multiple quality control steps to ensure the annotations are as free of noise as possible. For more details, please see our paper.

관련 논문 15편

QED

QED 설명 보기

QED is a linguistically principled framework for explanations in question answering. Given a question and a passage, QED represents an explanation of the answer as a combination of discrete, human-interpretable steps: sentence selection := identification of a sentence implying an answer to the question referential equality := identification of noun phrases in the question and the answer sentence that refer to the same thing predicate entailment := confirmation that the predicate in the sentence entails the predicate in the question once referential equalities are abstracted away. The QED dataset is an expert-annotated dataset of QED explanations build upon a subset of the Google Natural Questions dataset. Source: https://github.com/google-research-datasets/QED Image Source: https://github.com/google-research-datasets/QED

관련 논문 15편

QuerYD

QuerYD 설명 보기

A large-scale dataset for retrieval and event localisation in video. A unique feature of the dataset is the availability of two audio tracks for each video: the original audio, and a high-quality spoken description of the visual content. Source: QuerYD: A video dataset with high-quality textual and audio narrations

관련 논문 15편

REalistic and Diverse Scenes dataset realistic and dynamic scenes

REDS
REDS 설명 보기

The realistic and dynamic scenes (REDS) dataset was proposed in the NTIRE19 Challenge. The dataset is composed of 300 video sequences with resolution of 720×1,280, and each video has 100 frames, where the training set, the validation set and the testing set have 240, 30 and 30 videos, respectively Source: Video Super Resolution Based on Deep Learning: A comprehensive survey Image Source: https://seungjunnah.github.io/Datasets/reds.html

관련 논문 15편

Real Out-of-Domain Sentences From Task-oriented Dialog

ROSTD
ROSTD 설명 보기

A dataset of 4K out-of-domain (OOD) examples for the publicly available dataset from (Schuster et al. 2019). In contrast to existing settings which synthesize OOD examples by holding out a subset of classes, the examples were authored by annotators with apriori instructions to be out-of-domain with respect to the sentences in an existing dataset. Source: Likelihood Ratios and Generative Classifiers for Unsupervised Out-of-Domain Detection In Task Oriented Dialog

관련 논문 15편

RTMV

RTMV 설명 보기

RTMV is a large-scale synthetic dataset for novel view synthesis consisting of ∼300k images rendered from nearly 2000 complex scenes using high-quality ray tracing at high resolution (1600 × 1600 pixels). The dataset is orders of magnitude larger than existing synthetic datasets for novel view synthesis, thus providing a large unified benchmark for both training and evaluation. Using 4 distinct sources of high-quality 3D meshes, the scenes of our dataset exhibit challenging variations in camera views, lighting, shape, materials, and textures. The dataset consists of scenes from four different environments, namely Google Scanned Objects, ABC, Bricks and Amazon Berkeley. Each scene has 150 renders at a 1600 x 1600 resolution. Description adapted from: http://www.cs.umd.edu/~mmeshry/projects/rtmv/

관련 논문 15편

Repetitive Action Counting Dataset

RepCount
RepCount 설명 보기

Counting repetitive actions are widely seen in human activities such as physical exercise. Existing methods focus on performing repetitive action counting in short videos, which is tough for dealing with longer videos in more realistic scenarios. In the data-driven era, the degradation of such generalization capability is mainly attributed to the lack of long video datasets. To complement this margin, we introduce a new large-scale repetitive action counting dataset called RepCount covering a wide variety of video lengths, along with more realistic situations where action interruption or action inconsistencies occur in the video. Besides, we also provide a fine-grained annotation of the action cycles instead of just counting annotation along with a numerical value. Such a dataset contains 1451 videos with about 20000 annotations, which is more challenging. Furthermore, the dataset consists of two subsets namely Part-A and Part-B. The videos in Part-A are fetched from YouTube, while the others in Part-B record simulated physical examinations by junior school students and teachers.

관련 논문 15편

RoadAnomaly21

RoadAnomaly21 설명 보기

RoadAnomaly21 is a dataset for anomaly segmentation, the task of identify the image regions containing objects that have never been seen during training. It consists of an evaluation dataset of 100 images with pixel-level annotations. Each image contains at least one anomalous object, e.g. animals or unknown vehicles. The anomalies can appear anywhere in the image and widely differ in size, covering from 0.5% to 40% of the image

관련 논문 15편

Synthetic Vehicle Interior Rear Seat Occupancy Dataset

SVIRO
SVIRO 설명 보기

Contains bounding boxes for object detection, instance segmentation masks, keypoints for pose estimation and depth images for each synthetic scenery as well as images for each individual seat for classification. Source: SVIRO: Synthetic Vehicle Interior Rear Seat Occupancy Dataset and Benchmark

관련 논문 15편

SYSU-30k

SYSU-30k 설명 보기

SYSU-30k contains 30k categories of persons, which is about 20 times larger than CUHK03 (1.3k categories) and Market1501 (1.5k categories), and 30 times larger than ImageNet (1k categories). SYSU-30k contains 29,606,918 images. Moreover, SYSU-30k provides not only a large platform for the weakly supervised ReID problem but also a more challenging test set that is consistent with the realistic setting for standard evaluation. Source: https://github.com/wanggrun/SYSU-30k Image Source: https://github.com/wanggrun/SYSU-30k

관련 논문 15편

Salinas Scene

Salinas
Salinas 설명 보기

Salinas Scene is a hyperspectral dataset collected by the 224-band AVIRIS sensor over Salinas Valley, California, and is characterized by high spatial resolution (3.7-meter pixels). The area covered comprises 512 lines by 217 samples. 20 water absorption bands were discarder: [108-112], [154-167], 224. This image was available only as at-sensor radiance data. It includes vegetables, bare soils, and vineyard fields. Salinas groundtruth contains 16 classes.

관련 논문 15편

Segmentation in the Wild

Segmentation in the Wild 설명 보기

Recent advances in language-image pre-training has witnessed the emerging field of building transferable systems that can effortlessly adapt to a wide range of computer vision & multimodal tasks in the wild. This also poses a challenge to evaluate the transferability of these models due to the lack of easy-to-use evaluation toolkits and public benchmarks. "Segmentation in the Wild (SegInW)" Challenge is a part of X-Decoder, that proposed a new benchmark to evaluate the transfer ability of pre-trained vision models. This benchmark presents a diverse set of downstream segmentation datasets, measuring the ability of pre-training models on both the segmentation accuracy and their transfer efficiency in a new task, in terms of training examples and trainable parameters. This SegInW Challenge consists of 25 free public Segmentation datasets, crowd-sourced on roboflow.com. For more details about the challenge submission format, please refer to X-Decoder for SGinW.

관련 논문 15편

Syn2Real

Syn2Real 설명 보기

Syn2Real, a synthetic-to-real visual domain adaptation benchmark meant to encourage further development of robust domain transfer methods. The goal is to train a model on a synthetic "source" domain and then update it so that its performance improves on a real "target" domain, without using any target annotations. It includes three tasks, illustrated in figures above: the more traditional closed-set classification task with a known set of categories; the less studied open-set classification task with unknown object categories in the target domain; and the object detection task, which involves localizing instances of objects by predicting their bounding boxes and corresponding class labels. Source: Syn2Real Image Source: https://ai.bu.edu/syn2real/

관련 논문 15편

TITAN

TITAN 설명 보기

TITAN consists of 700 labeled video-clips (with odometry) captured from a moving vehicle on highly interactive urban traffic scenes in Tokyo. The dataset includes 50 labels including vehicle states and actions, pedestrian age groups, and targeted pedestrian action attributes that are organized hierarchically corresponding to atomic, simple/complex-contextual, transportive, and communicative actions. Source: TITAN: Future Forecast using Action Priors

관련 논문 15편

ToxCast (Toxicity Forecaster)

ToxCast (Toxicity Forecaster) 설명 보기

ToxCast is an initiative by the U.S. Environmental Protection Agency (EPA) aimed at predicting the potential toxicity of various chemical compounds. It involves high-throughput screening assays that evaluate thousands of chemicals across multiple biological endpoints. These endpoints cover a wide range of effects, including cell cycle disruptions, interactions with steroid receptors, and cytotoxicity.

관련 논문 15편

ToyADMOS

ToyADMOS 설명 보기

ToyADMOS dataset is a machine operating sounds dataset of approximately 540 hours of normal machine operating sounds and over 12,000 samples of anomalous sounds collected with four microphones at a 48kHz sampling rate, prepared by Yuma Koizumi and members in NTT Media Intelligence Laboratories. The ToyADMOS dataset is designed for anomaly detection in machine operating sounds (ADMOS) research. It is designed for three tasks of ADMOS: product inspection (toy car), fault diagnosis for fixed machine (toy conveyor), and fault diagnosis for moving machine (toy train). Source: https://github.com/YumaKoizumi/ToyADMOS-dataset

관련 논문 15편

UBody

UBody 설명 보기

UBody is a large-scale Upper-Body dataset with the following annotations: * 2D whole-body keypoints * 3D SMPLX annotations * Frame validity label * Person bounding box (bbox) * Hand bounding box (bbox)

관련 논문 15편

UFPR-ALPR

UFPR-ALPR 설명 보기

This dataset includes 4,500 fully annotated images (over 30,000 license plate characters) from 150 vehicles in real-world scenarios where both the vehicle and the camera (inside another vehicle) are moving. The images were acquired with three different cameras and are available in the Portable Network Graphics (PNG) format with a size of 1,920 × 1,080 pixels. The cameras used were: GoPro Hero4 Silver, Huawei P9 Lite, and iPhone 7 Plus. We collected 1,500 images with each camera, divided as follows: - 900 of cars with gray license plates; - 300 of cars with red license plates; - 300 of motorcycles with gray license plates. The dataset is split as follows: 40% for training, 40% for testing and 20% for validation. Every image has the following annotations available in a text file: the camera in which the image was taken, the vehicle’s position and information such as type (car or motorcycle), manufacturer, model and year; the identification and position of the license plate, as well as the position of its characters. Source: A Robust Real-Time Automatic License Plate Recognition Based on the YOLO Detector

관련 논문 15편

UIT-ViQuAD

UIT-ViQuAD 설명 보기

A new dataset for the low-resource language as Vietnamese to evaluate MRC models. This dataset comprises over 23,000 human-generated question-answer pairs based on 5,109 passages of 174 Vietnamese articles from Wikipedia. Source: A Vietnamese Dataset for Evaluating Machine Reading Comprehension

관련 논문 15편

Washington RGB-D

Washington RGB-D 설명 보기

Washington RGB-D is a widely used testbed in the robotic community, consisting of 41,877 RGB-D images organized into 300 instances divided in 51 classes of common indoor objects (e.g. scissors, cereal box, keyboard etc). Each object instance was positioned on a turntable and captured from three different viewpoints while rotating. Source: Learning Deep Visual Object Models From Noisy Web Data: How to Make it Work Image Source: https://rgbd-dataset.cs.washington.edu/

관련 논문 15편

Wisconsin (48%/32%/20% fixed splits)

Wisconsin (48%/32%/20% fixed splits) 설명 보기

Node classification on Wisconsin with the fixed 48%/32%/20% splits provided by Geom-GCN.

관련 논문 15편

XL-WiC

XL-WiC 설명 보기

A large multilingual benchmark, XL-WiC, featuring gold standards in 12 new languages from varied language families and with different degrees of resource availability, opening room for evaluation scenarios such as zero-shot cross-lingual transfer. Source: XL-WiC: A Multilingual Benchmark for Evaluating Semantic Contextualization

관련 논문 15편

xCodeEval

xCodeEval 설명 보기

xCodeEval is one of the largest executable multilingual multitask benchmarks consisting of 17 programming languages with execution-level parallelism. It features a total of seven tasks involving code understanding, generation, translation, and retrieval, and it employs an execution-based evaluation instead of traditional lexical approaches. It also provides a test-case-based multilingual code execution engine, ExecEval that supports all the programming languages in xCodeEval.

관련 논문 14편

2021 Hotel-ID

2021 Hotel-ID 설명 보기

2021 Hotel-ID is a dataset for hotel recognition to help raise awareness of human trafficking and generate novel approaches. The dataset consists of hotel room images that have been crowd-sourced and uploaded through the TraffickCam mobile application.