Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 65편

MMI Facial Expression Database

MMI
MMI 설명 보기

The MMI Facial Expression Database consists of over 2900 videos and high-resolution still images of 75 subjects. It is fully annotated for the presence of AUs in videos (event coding), and partially coded on frame-level, indicating for each frame whether an AU is in either the neutral, onset, apex or offset phase. A small part was annotated for audio-visual laughters. Source: https://mmifacedb.eu/ Image Source: https://mmifacedb.eu/

관련 논문 666편

Mostly Basic Python Programming

MBPP
MBPP 설명 보기

The benchmark consists of around 1,000 crowd-sourced Python programming problems, designed to be solvable by entry-level programmers, covering programming fundamentals, standard library functionality, and so on. Each problem consists of a task description, code solution and 3 automated test cases.

관련 논문 180편

Automated Programming Progress Standard

APPS
APPS 설명 보기

The APPS dataset consists of problems collected from different open-access coding websites such as Codeforces, Kattis, and more. The APPS benchmark attempts to mirror how humans programmers are evaluated by posing coding problems in unrestricted natural language and evaluating the correctness of solutions. The problems range in difficulty from introductory to collegiate competition level and measure coding ability as well as problem-solving. The Automated Programming Progress Standard, abbreviated APPS, consists of 10,000 coding problems in total, with 131,836 test cases for checking solutions and 232,444 ground-truth solutions written by humans. Problems can be complicated, as the average length of a problem is 293.2 words. The data are split evenly into training and test sets, with 5,000 problems each. In the test set, every problem has multiple test cases, and the average number of test cases is 21.2. Each test case is specifically designed for the corresponding problem, enabling us to rigorously evaluate program functionality. Source: Measuring Coding Challenge Competence With APPS Image source: Measuring Coding Challenge Competence With APPS

관련 논문 67편

SemEval 2019 Task 5: Multilingual Detection of Hate Speech Against Immigrants and Women in Twitter

HatEval
HatEval 설명 보기

Hate Speech is commonly defined as any communication that disparages a person or a group on the basis of some characteristic such as race, color, ethnicity, gender, sexual orientation, nationality, religion, or other characteristics. Given the huge amount of user-generated contents on the Web, and in particular on social media, the problem of detecting, and therefore possibly limit the Hate Speech diffusion, is becoming fundamental, for instance for fighting against misogyny and xenophobia. The proposed task consists in Hate Speech detection in Twitter but featured by two specific different targets, immigrants and women, in a multilingual perspective, for Spanish and English. The task will be articulated around two related subtasks for each of the involved languages: a basic task about Hate Speech, and another one where fine-grained features of hateful contents will be investigated in order to understand how existing approaches may deal with the identification of especially dangerous forms of hate, i.e. those where the incitement is against an individual rather than against a group of people, and where an aggressive behavior of the author can be identified as a prominent feature of the expression of hate. Participants will be asked to identify, on the one hand, if the target of hate is a single human or a group of persons, on the other hand, if the message author intends to be aggressive, harmful, or even to incite, in various forms, to violent acts against the target. - TASK A - Hate Speech Detection against Immigrants and Women: a two-class (or binary) classification where systems have to predict whether a tweet in English or in Spanish with a given target (women or immigrants) is hateful or not hateful. - TASK B - Aggressive behavior and Target Classification: where systems are asked first to classify hateful tweets for English and Spanish (e.g., tweets where Hate Speech against women or immigrants has been identified) as aggressive or not aggressive, and second to identify the target harassed as individual or generic (i.e. single human or group).

관련 논문 14편

SUMMIT

SUMMIT 설명 보기

SUMMIT is a high-fidelity simulator that facilitates the development and testing of crowd-driving algorithms. By leveraging the open-source OpenStreetMap map database and a heterogeneous multi-agent motion prediction model developed in our earlier work, SUMMIT simulates dense, unregulated urban traffic for heterogeneous agents at any worldwide locations that OpenStreetMap supports. SUMMIT is built as an extension of CARLA and inherits from it the physical and visual realism for autonomous driving simulation. SUMMIT supports a wide range of applications, including perception, vehicle control, planning, and end-to-end learning.

관련 논문 10편

CommitPackFT

CommitPackFT 설명 보기

CommitPackFT is a 2GB filtered version of CommitPack to contain only high-quality commit messages that resemble natural language instructions.

관련 논문 10편

CommitmentBank

CommitmentBank 설명 보기

The CommitmentBank is a corpus of 1,200 naturally occurring discourses whose final sentence contains a clause-embedding predicate under an entailment canceling operator (question, modal, negation, antecedent of conditional).

관련 논문 6편

Russian Commitment Bank

RCB
RCB 설명 보기

The Russian Commitment Bank is a corpus of naturally occurring discourses whose final sentence contains a clause-embedding predicate under an entailment cancelling operator (question, modal, negation, antecedent of conditional). ### Task Type RTE (Recognizing Textual Entailment) Sentence Pair Classification - Entailment - Contradiction - Neutral ### Example { "premise": "Сумма ущерба составила одну тысячу рублей. Уточняется, что на место происшествия выехала следственная группа, которая установила личность злоумышленника. Им оказался местный житель, ранее судимый за подобное правонарушение.", "hypothesis": "Ранее местный житель совершал подобное правонарушение.", "verb": "судить", "negation": "no_negation", "label": "entailment", "idx": 269 } ### How did we collect data? All text examples were collected from open news sources and literary magazines, then manually reviewed and supplemented by a human assessment on Yandex.Toloka.

관련 논문 5편

Hummingbird

Hummingbird 설명 보기

Hummingbird is a dataset to examine stylistic lexical cues from human perception and BERT used to characterize their discrepancy. In HUMMINGBIRD crowd-workers relabeled benchmarking datasets for style classification tasks.

관련 논문 4편

CommitChronicle

CommitChronicle 설명 보기

CommitChronicle is a dataset for commit message generation (and/or completion). Its key features: * large-scale and multilingual: contains 10.7M commits from 11.9k GitHub repositories in 20 programming languages; * diverse: avoids restrictive filtering on commit messages or commit diffs structure; * suitable for experiments with commit history: provides metadata about commit authors and dates and uses split-by-project. Available on 🤗 : JetBrains-Research/commit-chronicle

관련 논문 3편

Massively Multilingual Image Dataset

MMID
MMID 설명 보기

A large-scale multilingual corpus of images, each labeled with the word it represents. The dataset includes approximately 10,000 words in each of 100 languages. Source: Learning Translations via Images with a Massively Multilingual Image Dataset

관련 논문 2편

CHAMMI: A benchmark for channel-adaptive models in microscopy imaging

CHAMMI
CHAMMI 설명 보기

We present a cellular microscopic image dataset for investigating channel-adaptive models. We collected and pre-processed images from three publicly available sources: 1) the WTC-11 hiPSC dataset from the Allen Institute (Viana et al., 2023), 2) the Human Protein Atlas dataset (Thul et al., 2017), and 3) a combined Cell Painting dataset from the Broad Institute (Gustafsdottir et al., 2013; Bray et al., 2017; Way et al., 2021). These images contain 3, 4, or 5 channels with different cellular structures highlighted in each channel. The goal of this dataset is to facilitate the creation and evaluation of novel computer vision models that are invariant to channel numbers.

관련 논문 2편

Python Programming Puzzles (P3)

Python Programming Puzzles (P3) 설명 보기

Python Programming Puzzles (P3) is an open-source dataset where each puzzle is defined by a short Python program , and the goal is to find an input which makes output "True". The puzzles are objective in that each one is specified entirely by the source code of its verifier, so evaluating is all that is needed to test a candidate solution. They do not require an answer key or input/output examples, nor do they depend on natural language understanding. The dataset is comprehensive in that it spans problems of a range of difficulties and domains, ranging from trivial string manipulation problems that are immediately obvious to human programmers (but not necessarily to AI), to classic programming puzzles (e.g., Towers of Hanoi), to interview/competitive-programming problems (e.g., dynamic programming), to longstanding open problems in algorithms and mathematics (e.g., factoring). The objective nature of P3 readily supports self-supervised bootstrapping. Source: Programming Puzzles

관련 논문 2편

Summit Vitals: Multi-Camera and Multi-Signal Biosensing at High Altitudes

SUMS
SUMS 설명 보기

Here is SUMS dataset collected by Qinghai University. It is a multi-camera and multi-signal Biosensing dataset collected at high altitudes, which includes 80 synchronized non-contact facial and contact finger videos from 10 subjects during exercise and oxygen recovery scenarios. This dataset captures PPG, respiration rate (RR), and SpO2, and is designed to validate video vitals estimation algorithms and compare facial rPPG with finger cPPG. Our results demonstrate that fusing videos from different positions (face and finger) reduces the mean absolute error (MAE) of SpO2 predictions by 7.6% and 10.6% compared to using only face or only finger data. Additionally, training on multiple indicators such as PPG and blood oxygen simultaneously reduces SpO2 estimation MAE by 17.8%. We recruited ten participants living on the Qinghai Plateau to collect hypoxia data in a real high-altitude environment. Data collection utilized two Logitech C922 cameras to capture videos of participants’ faces and fingers, along with a CMS50E+ oximeter for measuring PPG signals and blood oxygen levels. Respiratory patterns were monitored using an HKH-11C respiratory sensor. Video recordings were captured at a resolution of 1280x720 pixels, running at 60 frames per second. The PPG signals were recorded at a frequency of 20 Hz, while respiratory waves were captured at 50 Hz. The experiment setup is shown as follows.

관련 논문 1편

CF-mMIMO data - measurement at USC

CF-mMIMO data - measurement at USC 설명 보기

This repo contains open-source channel measurement data for research and development purposes. Copyright Thomas Choi, University of Southern California. The data may be used for non-commercial purposes only. Redistribution prohibited. If you use this data for results presented in research papers, please cite as follows: Data were obtained from [Choi2021Using], whose data are available at [WiDeS_Choi2021Using]. [Choi2021Using] T. Choi et al., "Using a drone sounder to measure channels for cell-free massive MIMO systems," arXiv preprint arXiv:2106.15276, 2021. [WiDeS_Choi2021Using] T. Choi et al., “Open-Source Cell-Free Massive MIMO Channel Data 2020”. URL: https://wides.usc.edu/research_matlab.html

관련 논문 1편

Dataset of Grouped Commit Author IDs after Identity Resolution

Dataset of Grouped Commit Author IDs after Identity Resolution 설명 보기

This Dataset contains the IDs of 5,427,024 commit authors who have created commits in git version control system, and have more than 1 ID in git. It is a compressed CSV file (separated by ; ) with 14,861,538 author IDs, where the first column is the group ID, which is same as the first (randomly selected) author ID of the group, and the second column is the author ID that is part of the group. If an author was found to have 2 different IDs: I1, I2, then it is recorded in the file in 2 separate lines, with the lines being I1;I1 and I1;I2, i.e. the first column is the group identifier, which is one of the IDs in a group, and the second column contains the different author IDs in separate lines. This data set contains email addresses for various Git author's, but the '@' within the email address has been replaced with a '#'.

관련 논문 1편

MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversity

MMInstruct-GPT4V
MMInstruct-GPT4V 설명 보기

Vision-language supervised fine-tuning effectively enhances VLLM performance, but existing visual instruction tuning datasets have limitations: 1. Instruction Annotation Quality: Despite strong performance, advanced VLLMs may generate instructions with inaccuracies, such as hallucinations. 2. Instruction and Image Diversity: Limited instruction types and lack of diverse image data impact the model's ability to generate varied and realistic outputs. MMInstruct Dataset To address these challenges, we created the MMInstruct dataset, featuring: - 973K instructions from 24 domains - Four instruction types: Judgement, Multiple-Choice, Long Visual Question Answering, and Short Visual Question Answering.

관련 논문 1편

Jafar Akhoundali

MoreFixes: A Large-Scale Dataset of CVE Fix Commits Mined through Enhanced Repository Discovery
MoreFixes: A Large-Scale Dataset of CVE Fix Commits Mined through Enhanced Repository Discovery 설명 보기

In our work, we have designed and implemented a novel workflow with several heuristic methods to combine state-of-the-art methods related to CVE fix commits gathering. As a consequence of our improvements, we have been able to gather the largest programming language-independent real-world dataset of CVE vulnerabilities with the associated fix commits. Our dataset containing 26,617 unique CVEs coming from 6,945 unique GitHub projects is, to the best of our knowledge, by far the biggest CVE vulnerability dataset with fix commits available today. These CVEs are associated with 31,883 unique commits that fixed those vulnerabilities. Compared to prior work, our dataset brings about a 397% increase in CVEs, a 295% increase in covered open-source projects, and a 480% increase in commit fixes. Our larger dataset thus substantially improves over the current real-world vulnerability datasets and enables further progress in research on vulnerability detection and software security. We used NVD(nvd.nist.gov) and Github Secuirty advisory Database as the main sources of our pipeline. We release to the community a 14GB PostgreSQL database that contains information on CVEs up to January 24, 2024, CWEs of each CVE, files and methods changed by each commit, and repository metadata. Additionally, patch files related to the fix commits are available as a separate package. Furthermore, we make our dataset collection tool also available to the community. cvedataset-patches.zip file contains fix patches, and dump_morefixes_27-03-2024_19_52_58.sql.zip contains a postgtesql dump of fixes, together with several other fields such as CVEs, CWEs, repository meta-data, commit data, file changes, method changed, etc. MoreFixes data-storage strategy is based on CVEFixes to store CVE commits fixes from open-source repositories, and uses a modified version of Porspector(part of ProjectKB from SAP) as a module to detect commit fixes of a CVE. Our full methodology is presented in the paper, with the title of "MoreFixes: A Large-Scale Dataset of CVE Fix Commits Mined through Enhanced Repository Discovery", which will be published in the Promise conference (2024). For more information about usage and sample queries, visit the Github repository: https://github.com/JafarAkhondali/Morefixes If you are using this dataset, please be aware that the repositories that we mined contain different licenses and you are responsible to handle any licesnsing issues. This is also the similar case with CVEFixes. This product uses the NVD API but is not endorsed or certified by the NVD.

관련 논문 1편

Snowflake Dataset for "Shaved Ice: Optimal Compute Resource Commitments for Dynamic Multi-Cloud Workloads" paper

Shaved Ice Snowflake VM Demand Dataset
Shaved Ice Snowflake VM Demand Dataset 설명 보기

This repository contains documentation for the dataset that accompanies our ICPE 2025 paper, "Shaved Ice: Optimal Compute Resource Commitments for Dynamic Multi-Cloud Workloads". It also includes example R and Python notebooks to read and visualize the data, including scripts to reproduce the figures and analysis results in the paper. DOI This project is archived on Zenodo, an open-access repository, to ensure long-term reproducibility of the research. ## Dataset The dataset contains normalized and obfuscated hourly data about VM demand in four example Snowflake deployments over a period of 3 years from 2/1/2021 to 1/30/2024. Each hour includes (type of VM, region, number of VMs of that type) used at that time. This dataset is available in both compressed CSV and Parquet formats. ### Schema * Timestamp: An hourly timestamp for the record. * VM Type: This field is obfuscated with the precise VM identifier from the Cloud Service Provider mapped into a capital letter. * Region: The region where the VM was deployed. This field is obfuscated with the precise region name from the Cloud Service Provider mapped into a number between 1 and 4. * Count: The number of VMs of the specified type, region, and hour. This field is normalized such that the largest type, region, hour tuple is set to 1000 in each region and other values are scaled linearly to the nearest whole number. ## Potential Use Cases Provides realistic industry dataset for further research into cloud demand forecasting, commitment optimization, and capacity planning.

관련 논문 0편

ScreenCast ANalysis for Video Programming Tutorials

CodeSCAN
CodeSCAN 설명 보기

CodeSCAN is the first large-scale and diverse dataset of coding screenshots with pixel-perfect annotations. It features: - 24 popular programming languages (according to Github) - 100 random repositories per language (with MIT, BSD-3 or WTFPL License), i.e. 2.400 repositories in total - Per repository we use 5 files, i.e. 12.000 files in total - ~100 different themes and 25 different fonts - Diverse layouts changes, such as menu bar visibility, sidebar position, output window content, etc. - Numerous realistic interactions such as searching, typing and selecting within a file, etc. Check our project page (https://a-nau.github.io/codescan/) for details.

관련 논문 0편

Data for 'Precision Oncology, Signaling Pathways Reprogramming and Targeted Therapy: A Holistic Approach to Molecular Cancer The

Data for 'Precision Oncology, Signaling Pathways Reprogramming and Targeted Therapy: A Holistic Approach to Molecular Cancer The 설명 보기

Cancer genomics and precision oncology: The TCGA Research Network started in 2005 has profiled and analyzed a large number of human tumors to discover molecular aberrations at the DNA, RNA, protein, and epigenetic levels and thereby provided reliable diagnostic and prognostic biomarkers for different cancer types since then.The presence of mutated genes is strongly correlated with cancer incidence, very specific causative genes or a small set of genes for most cancers have not been confirmed after decades of genomic studies. Nobel laureate James D. Watson opined at Cancer World 2013: "We can go ahead and sequence every piece of DNA that has ever existed, but I don't think we'll find the Achilles heel of cancer. Importantly,, it is not only necessary to associate genetic mutations with different cancers but also to work on the mechanism of action of mutagens by focusing on enzymes which could invariably mediate oncogenic transformations. For example, overexpression of the ribonucleotide reductase (RnR) enzyme which catalyzes the formation of deoxyribonucleotides from ribonucleotides necessary for cell division, is implicated in many forms of cancer and the genes for the components of the enzyme are often mutated, leading to hyperactivity of the enzyme. But there are instances indicating that cytoplasmic material rather than the karyoplast would be responsible for cellular transformation that might be better explained as a consequence of certain epigenetic modulation than purely genetic changes. .RnR active site inhibitors have been developed accordingly to biophysically deactivate the enzyme when necessary, with positive results A comprehensive analysis of tumors based on their genomic studies must reveal the alterations in signaling pathways indicating patterns of vulnerabilities and the means to identify prospective targets for the development of personalized treatments and new combination therapies.Nobel laureate James D. In this regard, the Cancer Cell Map Initiative (CCMI), launched in 2015 by researchers at the University of California, San Francisco and the University of California, San Diego, allowed researchers to determine how hundreds of genetic mutations involved in a few types of cancer affect the activity of certain crucial proteins which ultimately lead to the manifestation of cancer. As there is a large amount of sequence data from many different cancer types, efforts are being made to extract mechanistic insights from the available information, requiring an integrated computational and experimental strategy that will help place these alterations in the higher order contexts of signaling mechanisms in cancer cells. This is the defined goal of the CCMI and has the potential to create a resource that can be used for cancer genome interpretation, enabling the identification of key complexes and pathways to better understand the biology underlying different cancer types and conditions for precise treatment of the disease.

관련 논문 0편

Precision Oncology, Signaling Pathways Reprogramming and Targeted Therapy: A Holistic Approach to Molecular Cancer Therapeutics

Precision Oncology, Signaling Pathways Reprogramming and Targeted Therapy: A Holistic Approach to Molecular Cancer Therapeutics 설명 보기

Cancer genomics and precision oncology: The TCGA Research Network started in 2005 has profiled and analyzed a large number of human tumors to discover molecular aberrations at the DNA, RNA, protein, and epigenetic levels and thereby provided reliable diagnostic and prognostic biomarkers for different cancer types since then.The presence of mutated genes is strongly correlated with cancer incidence, very specific causative genes or a small set of genes for most cancers have not been confirmed after decades of genomic studies. Nobel laureate James D. Watson opined at Cancer World 2013: "We can go ahead and sequence every piece of DNA that has ever existed, but I don't think we'll find the Achilles heel of cancer. Importantly,, it is not only necessary to associate genetic mutations with different cancers but also to work on the mechanism of action of mutagens by focusing on enzymes which could invariably mediate oncogenic transformations. For example, overexpression of the ribonucleotide reductase (RnR) enzyme which catalyzes the formation of deoxyribonucleotides from ribonucleotides necessary for cell division, is implicated in many forms of cancer and the genes for the components of the enzyme are often mutated, leading to hyperactivity of the enzyme. But there are instances indicating that cytoplasmic material rather than the karyoplast would be responsible for cellular transformation that might be better explained as a consequence of certain epigenetic modulation than purely genetic changes. .RnR active site inhibitors have been developed accordingly to biophysically deactivate the enzyme when necessary, with positive results A comprehensive analysis of tumors based on their genomic studies must reveal the alterations in signaling pathways indicating patterns of vulnerabilities and the means to identify prospective targets for the development of personalized treatments and new combination therapies.Nobel laureate James D. In this regard, the Cancer Cell Map Initiative (CCMI), launched in 2015 by researchers at the University of California, San Francisco and the University of California, San Diego, allowed researchers to determine how hundreds of genetic mutations involved in a few types of cancer affect the activity of certain crucial proteins which ultimately lead to the manifestation of cancer. As there is a large amount of sequence data from many different cancer types, efforts are being made to extract mechanistic insights from the available information, requiring an integrated computational and experimental strategy that will help place these alterations in the higher order contexts of signaling mechanisms in cancer cells. This is the defined goal of the CCMI and has the potential to create a resource that can be used for cancer genome interpretation, enabling the identification of key complexes and pathways to better understand the biology underlying different cancer types and conditions for precise treatment of the disease.