Papers with Code · CC BY-SA 4.0

데이터셋 탐색

데이터셋의 설명·홈페이지를 찾고, 관련 태스크의 평가 기록을 살펴보세요.

관련 논문 100편

Consolidated Receipt Dataset for Post-OCR Parsing

CORD
CORD 설명 보기

OCR is inevitably linked to NLP since its final output is in text. Advances in document intelligence are driving the need for a unified technology that integrates OCR with various NLP tasks, especially semantic parsing. Since OCR and semantic parsing have been studied as separate tasks so far, the datasets for each task on their own are rich, while those for the integrated post-OCR parsing tasks are relatively insufficient. In this study, we publish a consolidated dataset for receipt parsing as the first step towards post-OCR parsing tasks. The dataset consists of thousands of Indonesian receipts, which contains images and box/text annotations for OCR, and multi-level semantic labels for parsing. The proposed dataset can be used to address various OCR and parsing tasks.

관련 논문 115편

The Highway Drone Dataset Naturalistic Trajectories of 110 500 Vehicles Recorded at German Highways

highD Dataset
highD Dataset 설명 보기

The highD dataset is a new dataset of naturalistic vehicle trajectories recorded on German highways. Using a drone, typical limitations of established traffic data collection methods such as occlusions are overcome by the aerial perspective. Traffic was recorded at six different locations and includes more than 110 500 vehicles. Each vehicle's trajectory, including vehicle type, size and manoeuvres, is automatically extracted. Using state-of-the-art computer vision algorithms, the positioning error is typically less than ten centimeters. Although the dataset was created for the safety validation of highly automated vehicles, it is also suitable for many other tasks such as the analysis of traffic patterns or the parameterization of driver models.

관련 논문 111편

ReCoRD

ReCoRD 설명 보기

Reading Comprehension with Commonsense Reasoning Dataset (ReCoRD) is a large-scale reading comprehension dataset which requires commonsense reasoning. ReCoRD consists of queries automatically generated from CNN/Daily Mail news articles; the answer to each query is a text span from a summarizing passage of the corresponding news. The goal of ReCoRD is to evaluate a machine's ability of commonsense reasoning in reading comprehension. ReCoRD is pronounced as [ˈrɛkərd]. Image Source: Zhang et al

관련 논문 21편

STARSS23: An Audio-Visual Dataset of Spatial Recordings of Real Scenes with Spatiotemporal Annotations of Sound Events

STARSS23
STARSS23 설명 보기

The Sony-TAu Realistic Spatial Soundscapes 2023 (STARSS23) dataset contains multichannel recordings of sound scenes in various rooms and environments, together with temporal and spatial annotations of prominent events belonging to a set of target classes. The dataset is collected in two different countries, in Tampere, Finland by the Audio Researh Group (ARG) of Tampere University (TAU), and in Tokyo, Japan by SONY, using a similar setup and annotation procedure. The dataset is delivered in two 4-channel spatial recording formats, a microphone array one (MIC), and first-order Ambisonics one (FOA). These recordings serve as the development dataset for the DCASE 2023 Sound Event Localization and Detection Task of the DCASE 2023 Challenge.

관련 논문 8편

2018 n2c2 shared task on adverse drug events and medication extraction in electronic health records

2018 n2c2 (Track 2) - Adverse Drug Events and Medication Extraction
2018 n2c2 (Track 2) - Adverse Drug Events and Medication Extraction 설명 보기

Abstract Objective This article summarizes the preparation, organization, evaluation, and results of Track 2 of the 2018 National NLP Clinical Challenges shared task. Track 2 focused on extraction of adverse drug events (ADEs) from clinical records and evaluated 3 tasks: concept extraction, relation classification, and end-to-end systems. We perform an analysis of the results to identify the state of the art in these tasks, learn from it, and build on it. Materials and Methods For all tasks, teams were given raw text of narrative discharge summaries, and in all the tasks, participants proposed deep learning–based methods with hand-designed features. In the concept extraction task, participants used sequence labelling models (bidirectional long short-term memory being the most popular), whereas in the relation classification task, they also experimented with instance-based classifiers (namely support vector machines and rules). Ensemble methods were also popular. Results A total of 28 teams participated in task 1, with 21 teams in tasks 2 and 3. The best performing systems set a high performance bar with F1 scores of 0.9418 for concept extraction, 0.9630 for relation classification, and 0.8905 for end-to-end. However, the results were much lower for concepts and relations of Reasons and ADEs. These were often missed because local context is insufficient to identify them. Conclusions This challenge shows that clinical concept extraction and relation classification systems have a high performance for many concept types, but significant improvement is still required for ADEs and Reasons. Incorporating the larger context or outside knowledge will likely improve the performance of future systems.

관련 논문 8편

ICSI Meeting Recorder Dialog Act Corpus

MRDA
MRDA 설명 보기

The MRDA corpus consists of about 75 hours of speech from 75 naturally-occurring meetings among 53 speakers. The tagset used for labeling is a modified version of the SWBD-DAMSL tagset. It is annotated with three types of information: marking of the dialogue act segment boundaries, marking of the dialogue acts and marking of correspondences between dialogue acts. Description from NLP Progress

관련 논문 5편

AF Classification from a Short Single Lead ECG Recording - The PhysioNet Computing in Cardiology Challenge 2017

AF Classification from a Short Single Lead ECG Recording - The PhysioNet Computing in Cardiology Challenge 2017 설명 보기

The 2017 PhysioNet/CinC Challenge aims to encourage the development of algorithms to classify, from a single short ECG lead recording (between 30 s and 60 s in length), whether the recording shows normal sinus rhythm, atrial fibrillation (AF), an alternative rhythm, or is too noisy to be classified.

관련 논문 5편

A Real-Recorded and Annotated Microphone Array Dataset for Dynamic Speech Enhancement and Localization

RealMAN
RealMAN 설명 보기

The Audio Signal and Information Processing Lab at Westlake University, in collaboration with AISHELL, has released the Real-recorded and annotated Microphone Array speech&Noise (RealMAN) dataset, which provides annotated multi-channel speech and noise recordings for dynamic speech enhancement and localization: - Microphone array: A 32-channel microphone array with high-fidelity microphones is used for recording - Speech source: A loudspeaker is used for playing source speech signals (about 35 hours of Mandarin speech) - Recording duration and scene: A total of 83.7 hours of speech signals (about 48.3 hours for static speaker and 35.4 hours for moving speaker) are recorded in 32 different scenes, and 144.5 hours of background noise are recorded in 31 different scenes. Both speech and noise recording scenes cover various common indoor, outdoor, semi-outdoor and transportation environments, which enables the training of general-purpose speech enhancement and source localization networks. - Annotation: To obtain the task-specific annotations, speaker location is annotated with an omni-directional fisheye camera by automatically detecting the loudspeaker. The direct-path signal is set as the target clean speech for speech enhancement, which is obtained by filtering the source speech signal with an estimated direct-path propagation filter.

관련 논문 3편

CORD-r

CORD-r 설명 보기

We introduce FUNSD-r and CORD-r in Token Path Prediction, the revised VrD-NER datasets to reflect the real-world scenarios of NER on scanned VrDs. In FUNSD and CORD, segment layout annotations are aligned with labeled entities, which makes them not reflect the reading order issue of NER on scanned VrDs, and thus are unsuitable for evaluating current methods. In FUNSD-r and CORD-r, we automatically reannotate the layouts using PP-OCRv3 OCR system, and manually reannotate the named entities as word sequences based on the new layout annotations. Their segment layout annotations are aligned with real-world situations and entity mentions are labeled on words. The proposed CORD-r consists of 999 document samples including the image, layout annotation of segments and words, and labeled entities of 30 categories. For the detailed summary statistics, please refer to the original paper.

관련 논문 2편

3D-Point Cloud dataset of various geometrical terrains in urban environments recorded during human locomotion

3D-Point Cloud dataset of various geometrical terrains
3D-Point Cloud dataset of various geometrical terrains 설명 보기

Depth vision has been recently used in many locomotion devices with the objective to ease the life of disabled people toward reaching more ecological lifestyle. This is due to the fact that such cameras are cheap, compact and can provide rich information about the environment. Our dataset provides many recordings of point cloud and other types of data during different locomotion modes in urban context. If you used this data, please cite the following papers below: 1-Depth Vision based Terrain Detection Algorithm during Human Locomotion 2-Using Depth Vision for Terrain Detection during Active Locomotion

관련 논문 2편

DACCORD

DACCORD 설명 보기

DACCORD is a new dataset dedicated to the task of automatically detecting contradictions between sentences in French. The dataset is currently composed of 1034 sentence pairs. It covers the themes of Russia’s invasion of Ukraine in 2022, the Covid-19 pandemic, and the climate crisis.

관련 논문 2편

Online Cryptocurrency-topic diffusion on Twitter, Telegram, and Discord

Online Cryptocurrency-topic diffusion on Twitter, Telegram, and Discord 설명 보기

This Dataset is described in Charting the Landscape of Online Cryptocurrency Manipulation. IEEE Access (2020), a study that aims to map and assess the extent of cryptocurrency manipulations within and across the online ecosystems of Twitter, Telegram, and Discord. Starting from tweets mentioning cryptocurrencies, we leveraged and followed invite URLs from platform to platform, building the invite-link network, in order to study the invite link diffusion process. Please, refer to the paper below for more details. Nizzoli, L., Tardelli, S., Avvenuti, M., Cresci, S., Tesconi, M. & Ferrara, E. (2020). Charting the Landscape of Online Cryptocurrency Manipulation. IEEE Access (2020). This dataset is composed of: ~16M tweet ids shared between March and May 2019, mentioning at least one of the 3,822 cryptocurrencies (cashtags) provided by the CryptoCompare public API; ~13k nodes of the invite-link network, i.e., the information about the Telegram/Discord channels and Twitter users involved in the cryptocurrency discussion (e.g., id, name, audience, invite URL); ~62k edges of the invite-link network, i.e., the information about the flow of invites (e.g., source id, target id, weight).

관련 논문 2편

Dataset of British English speech recordings for psychoacoustics and speech processing research

The Clarity Speech Corpus
The Clarity Speech Corpus 설명 보기

The Clarity Speech Corpus is a forty speaker British English speech dataset. The corpus was created for the purpose of running listening tests to gauge speech intelligibility and quality in the Clarity Project, which has the goal of advancing speech signal processing by hearing aids through a series of challenges. The dataset is suitable for machine learning and other uses in speech and hearing technology, acoustics and psychoacoustics. The data comprises recordings of approximately 10,000 sentences drawn from the British National Corpus (BNC) with suitable length, words and grammatical construction for speech intelligibility testing. The collection process involved the selection of a subset of BNC sentences, the recording of these produced by 40 British English speakers, and the processing of these recordings to create individual sentence recordings with associated prompts and metadata.

관련 논문 2편

WildPPG: A Real-World PPG Dataset of Long Continuous Recordings

WildPPG
WildPPG 설명 보기

a dataset of multi-modal signals from wearable devices at four sites on the body. Each device continuously recorded synchronized signals from a 3-channel reflective photoplethysmogram (red, green, infrared PPG), 3-axis inertial sensor (accelerometer), temperature, and barometric altitude sensor. For reference, the sternum device continuously recorded a Lead-I electrocardiogram (ECG) from body-mounted gel electrodes to provide ground-truth heart rate (HR) estimates.

관련 논문 2편

LoRaWAN Path Loss Measurements in an Indoor Office Setting including Environmental Factors/Conditions

https://zenodo.org/records/15349731
https://zenodo.org/records/15349731 설명 보기

This dataset was collected during a LoRaWAN measurement campaign in a multi-room indoor office environment in the University of Siegen, Germany. It contains over 1.7 million time-stamped records from 6 LoRaWAN nodes transmitting once per minute to a single gateway. Each record includes environmental parameters: temperature, relative humidity, barometric pressure, particulate matter (PM2.5), and carbon dioxide (CO₂); as well as device metadata such as RSSI, SNR, spreading factor (SF), etc. The dataset also includes the effective signal power (ESP) and the noise (NP) for LoRaWAN propagation analysis purposes. The dataset is designed to support research on indoor wireless propagation, distance estimation, environment-aware modeling, among other IoT use cases and applications in line with the 6G flagship demands. A detailed methodology and initial analysis are presented in our accompanying IEEE Access paper: Nahshon Mokua Obiri and Kristof Van Laerhoven, "A Comprehensive Data Description for LoRaWAN Path Loss Measurements in an Indoor Office Setting: Effects of Environmental Factors," in IEEE Access, vol. 13, pp. 83148-83170, 2025, doi: 10.1109/ACCESS.2025.3569164.

관련 논문 1편

A dataset of neonatal EEG recordings with seizures annotations

A dataset of neonatal EEG recordings with seizures annotations 설명 보기

Neonatal seizures are a common emergency in the neonatal intensive care unit (NICU). There are many questions yet to be answered regarding the temporal/spatial characteristics of seizures from different pathologies, response to medication, effects on neurodevelopment and optimal detection. This dataset contains EEG recordings from human neonates and the visual interpretation of the EEG by the human expert. Multi-channel EEG was recorded from 79 term neonates admitted to the neonatal intensive care unit (NICU) at the Helsinki University Hospital. The median recording duration was 74 minutes (IQR: 64 to 96 minutes). EEGs were annotated by three experts for the presence of seizures. An average of 460 seizures were annotated per expert in the dataset, 39 neonates had seizures by consensus and 22 were seizure free by consensus. The dataset can be used as a reference set of neonatal seizures, for the development of automated methods of seizure detection and other EEG analysis, as well as for the analysis of inter-observer agreement.

관련 논문 1편

ACCORD CSQA 0-5

ACCORD CSQA 0-5 설명 보기

ACCORD CSQA is an extension of the popular CommonsenseQA (CSQA) dataset using ACCORD, a scalable framework for disentangling the commonsense grounding and reasoning abilities of large language models (LLMs) through controlled, multi-hop counterfactuals. ACCORD closes the measurability gap between commonsense and formal reasoning tasks for LLMs. A detailed understanding of LLMs' commonsense reasoning abilities is severely lagging compared to our understanding of their formal reasoning abilities, since commonsense benchmarks are difficult to construct in a manner that is rigorously quantifiable. Specifically, prior commonsense reasoning benchmarks and datasets are limited to one- or two-hop reasoning or include an unknown (i.e., non-measurable) number of reasoning hops and/or distractors. Arbitrary scalability via compositional construction is also typical of formal reasoning tasks but lacking in commonsense reasoning. Finally, most prior commonsense benchmarks either are limited to a single reasoning skill or do not control skills. ACCORD aims to address all these gaps by introducing formal elements to commonsense reasoning to explicitly control and quantify reasoning complexity beyond the typical 1 or 2 reasoning hops. Uniquely, ACCORD can automatically generate benchmarks of arbitrary reasoning complexity, and so it scales with future LLM improvements. ACCORD CSQA is a benchmark suite comprising problem with 6 levels of reasoning difficulty, ACCORD CSQA 0 to ACCORD CSQA 5. Experiments on state-of-the-art LLMs show performance degrading to random chance with only moderate scaling, leaving substantial headroom for improvement.

관련 논문 1편

Ambisonics Recordings of Typical Environments

ARTE
ARTE 설명 보기

The ARTE database, so far, contains 13 acoustic environments that were recorded with a purpose-built 62-channel microphone array in various locations around Sydney (Australia), and was decoded into the higher-order Ambisonics (HOA) format. For each acoustic environment the following files are provided: HOA environment files: The recorded environments were decoded into 31mixed-order HOA channels and saved as WAV-files with a sampling frequency of 44.1 kHz and 32 bits per sample. Thereby, channels 1-25 refer to the 3D HOA periphonic (horizontal) components up to the order of M = 4, and channels 26-31 refer to additional sectorial 2D components (i.e., m = n) up to the order of M = 7. HOA RIR files: In each environment, Room Impulse Responses (RIRs) were measured with a Tannoy V8 dual-concentric loudspeaker at a number of positions relative to the microphone array. Currently, only a single RIR is provided in each environment which was measured with a loudspeaker in front of the microphone array (0 degree azimuth) at a distance of 1.3 m. Similar to the noise files, the RIRs are provided as 31-channel WAV-files with a sampling frequency of 44.1 kHz and 32 bits per sample. In addition to the “standard” RIR, a second version is provided in which the RIR was split into a direct sound (DS) component as well as a reverberation component (REV). The separated version of the RIR can be useful for enhancing the directionality (and frequency response) of the direct sound by decoding it into a single loudspeaker channel (i.e., a loudspeaker at an azimuth angle of 0 degrees) and then adding it back to the reverberant component, which is decoded normally. This process has been shown to be particularly useful when evaluating the benefit provided by directional signal enhancement methods (e.g., beamformers) in hearing aids. Binaural environment files: The HOA noise files were transformed into binaural headphone signals by simulating their playback via a 41-channel loudspeaker array to the in-ear microphones of a calibrated Bruel & Kjaer Head and Torso Simulator (HATS type 4128C). These binaural signals are provided in two versions: (a) an unprocessed version that needs to be presented via headphones that are equalized using an artificial ear and (b) a version that can be directly played back via any diffuse-field equalized headphones. Binaural RIRs: The HOA RIRs were transformed into binaural RIRs in the same way as the HOA noise files (see above) and were saved both unequalized and diffuse-field equalized. Basic acoustic measures: A number of basic acoustic measures are provided by a separate PDF-file for each environment, including: (a) unweighted sound pressure levels (dB SPL), (b) A-weighted sound pressure levels (dBA), (c) reverberation time (RT60), (d) third-octave power spectra in dB SPL, (e) temporal envelopes, (f) amplitude modulation spectra, and (g) directional characteristics in the horizontal plane. The acoustic measures were derived by simulating the playback of the MOA noise files (and RIRs) via a 41-channel loudspeaker array to a calibrated omni-directional 1/4” GRAS microphone (Type 46BL). Apart from the acoustic environment specific files, the ARTE database includes a number of MatlabTM functions that help decoding the provided HOA files into a format that can be played back via a given loudspeaker array, and includes a number of examples. Further technical details are described in Weisser, et al. (2019). Supporting material: The provided MatlabTM scripts and examples assume that the downloaded files are organized in a specific directory structure. This structure is generated automatically when downloading (and unzipping) the main zip-file (ARTE database downloas.7z). Note that this zip-file contains all required functions except the MOA and binaural sound files and RIRs. Due to their file size (about 10 GB in total), these sound files should be downloaded, one by one, from the individual links provided below. Some notes on calibration: All HOA noise files were normalized in the same way such that they correctly maintain their original differences in sound pressure level. Hence, once the sensitivity of the loudspeaker playback system is known, the same playback gain must be applied to all noise files. Even though this playback gain can be derived using any of the provided noise files, the easiest noise file for calibrating the loudspeaker playback system is the provided diffuse noise due to its steady-state behavior. Given that most playback environments contain significant low-frequency background noise, and loudspeakers have different low-frequency roll-offs, the provided A-weighted sound pressure levels should be best used for calibration. Also, it is assumed here that all loudspeakers in the playback array have the same distance to the listener, identical sensitivity, and a flat frequency response. If this is not the case the loudspeakers need to be equalized individually. Also, reverberation of the playback room should be as low as possible. Acknowledgement: The development of the ARTE database was financially supported by the HEARing CRC, established and supported under the Cooperative Research Centres Program – an initiative of the Australian Government, and the Oticon foundation. References: Weisser, A., Buchholz, J. M., Oreinos, C., Badajoz-Davila, J., Galloway, J., Beechey, T., Keidser, G. (2019). The Ambisonics Recordings of Typical Environments (ARTE) database. Acta Acustica united with Acustica. (see provided pdf-file)

관련 논문 1편

CANDOR = Conversation: A Naturalistic Dataset of Online Recordings

CANDOR Corpus
CANDOR Corpus 설명 보기

The CANDOR corpus is a large, novel, multimodal corpus of 1,656 recorded conversations in spoken English. This 7+ million word, 850 hour corpus totals over 1TB of audio, video, and transcripts, with moment-to-moment measures of vocal, facial, and semantic expression, along with an extensive survey of speaker post conversation reflections.

관련 논문 1편

CORD19 Tiny Graph Dataset

CORD19 Tiny Graph Dataset 설명 보기

This dataset is crated via finding the citation links between papers in CORD19 Dataset. We used only a small subset of the all graph by choosing papers that have 20 or more citation.

관련 논문 1편

Congressional Voting Records Data Set

CVR
CVR 설명 보기

This data set includes votes for each of the U.S. House of Representatives Congressmen on the 16 key votes identified by the CQA. The CQA lists nine different types of votes: voted for, paired for, and announced for (these three simplified to yea), voted against, paired against, and announced against (these three simplified to nay), voted present, voted present to avoid conflict of interest, and did not vote or otherwise make a position known (these three simplified to an unknown disposition).

관련 논문 1편

Daily Activity Recordings for AI and ML applications

DARai
DARai 설명 보기

Daily Activity Recordings for Artificial Intelligence (DARai, pronounced "Dahr-ree") is a multimodal, hierarchically annotated dataset constructed to understand human activities in real-world settings. DARai consists of continuous scripted and unscripted recordings of 50 participants in 10 different environments, totaling over 200 hours of data from 20 sensors including multiple camera views, depth and radar sensors, wearable inertial measurement units (IMUs), electromyography (EMG), insole pressure sensors, biomonitor sensors, and gaze tracker. To capture the complexity in human activities, DARai is annotated at three levels of hierarchy: (i) high-level activities (L1) that are independent tasks, (ii) lower-level actions (L2) that are patterns shared between activities, and (iii) fine-grained procedures (L3) that detail the exact execution steps for actions. The dataset annotations and recordings are designed so that 22.7% of L2 actions are shared between L1 activities and 14.2% of L3 procedures are shared between L2 actions. The overlap and unscripted nature of DARai allows counterfactual activities in the dataset. Experiments with various machine learning models showcase the value of DARai in uncovering important challenges in human-centered applications. Specifically, we conduct unimodal and multimodal sensor fusion experiments for recognition, temporal localization, and future action anticipation across all hierarchical annotation levels. To highlight the limitations of individual sensors, we also conduct domain-variant experiments that are enabled by DARai's multi-sensor and counterfactual activity design setup. The code, documentation, and dataset are available at the dedicated DARai website.

관련 논문 1편

Device Recorded VCTK

DR-VCTK
DR-VCTK 설명 보기

This dataset is a new variant of the voice cloning toolkit (VCTK) dataset: device-recorded VCTK (DR-VCTK), where the high-quality speech signals recorded in a semi-anechoic chamber using professional audio devices are played back and re-recorded in office environments using relatively inexpensive consumer devices.

관련 논문 1편

Daily load patterns of six global exchanges as recorded by vwd/Infront Financial Technology

Daily load patterns
Daily load patterns 설명 보기

This data set provides fine-granular statistics on trading traffic generated by six global exchanges over the course of two days in February 2019 for a set of representative feeds and recorded by the systems of vwd Vereinigte Wirtschaftsdienste GmbH (now known as Infront Financial Technology GmbH). Please note that these numbers represent only limited market segments of the actual exchange and the measured feeds might provide different products and instrument types. The exchanges are identified as AU = Sydney, FFM = Frankfurt am Main (GER), HK = Hong Kong (CN), Q = NASDAQ (USA), TK = Tokyo (JPN), UK = London (UK). Please see the Zenodo page https://doi.org/10.5281/zenodo.6381970 for details on syntax etc.

관련 논문 1편

Data for: "Linking Datasets on Organizations Using Half a Billion Open-Collaborated Records"

Data for: "Linking Datasets on Organizations Using Half a Billion Open-Collaborated Records" 설명 보기

Source: Linking Datasets on Organizations Using Half-a-Billion Open-Collaborated Records (Description (Markdown and LATEX enabled)) ### High-Level Explanation of the Dataset - Scale and Composition: This repository provides millions of positive and negative name match examples (e.g., “PosMatches_mat.csv,” “NegMatches_mat.csv,” etc.) derived from LinkedIn data, alongside bipartite and Markov network representations of organizational relationships. - LinkedIn-Based Training Corpus: By leveraging the open-collaborated records from LinkedIn, the dataset offers a vast repository of string pairs—covering trillions of potential organization name matches—designed to refine and improve the accuracy of fuzzy matching techniques. ### Motivations and Summary of Content - Overcoming String Matching Challenges: Standard fuzzy matching struggles with highly variable and context-dependent organization names. This dataset was created to provide large-scale, diverse examples for training advanced machine learning models to address these limitations. - Network Representation: In addition to direct name-pair examples, the dataset includes bipartite and Markov network files that capture relationships between organizations, recognizing that organizational matching often depends on structural ties (e.g., shared employees or affiliated branches). - Examples Folder: The Example* directories illustrate how the data can be integrated into typical merging tasks: each folder includes x and y variables (e.g., by_x and by_y) and a merged z dataset, demonstrating how linkage can be evaluated and improved in applied research settings. ### Potential Use Cases 1. Entity Resolution / Record Linkage: Researchers and data scientists can use the millions of positive and negative organizational name matches to train more robust entity resolution algorithms across various domains (e.g., nonprofit, corporate, government datasets). 2. Network Analysis: The bipartite and Markov network representations allow for investigations into the structural connectivity of organizations, uncovering patterns in how organizational names (and, by extension, entities) relate to one another. 3. Benchmarking and Methodological Development: Method developers can employ this corpus to benchmark and stress-test new string matching approaches, harnessing the dataset’s size and diversity to refine algorithmic performance. 4. Domain-Specific Applications: Researchers studying lobbying firms, nonprofits, or other organizational types can integrate this dataset to improve the reliability of merges between multiple datasets that lack standardized IDs. For further details or questions, please contact the authors at the email provided in the repository.

관련 논문 1편

EEG data recorded during spoken and imagined speech interaction with a simulated robot

EEG Speech-Robot Interaction Dataset
EEG Speech-Robot Interaction Dataset 설명 보기

Dataset Description This dataset consists of Electroencephalography (EEG) data recorded from 15 healthy subjects using a 64-channel EEG headset during spoken and imagined speech interaction with a simulated robot. ## Citation The dataset recording and study setup are described in detail in the following publications: 1. Rekrut, M., Selim, A. M., & Krüger, A. (2022, October). Improving Silent Speech BCI Training Procedures Through Transfer from Overt to Silent Speech. In 2022 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2650–2656. IEEE. https://doi.org/10.1109/SMC53654.2022.9945447 2. Selim, A. M., Rekrut, M., Barz, M., & Sonntag, D. (2024, June). Speech Imagery BCI Training Using Game with a Purpose. In Proceedings of the 2024 International Conference on Advanced Visual Interfaces (AVI ’24). Association for Computing Machinery, New York, NY, USA, 1–5. https://doi.org/10.1145/3656650.3656654 If you use this dataset, please consider citing these works. --- # Study Design Participants controlled a simulated robot on a screen in a game-like setup through a maze while EEG data was recorded. Below are the key details: ## Experimental Setup - Interaction Modes: - Overt Speech: Speaking command words aloud. - Imagined Speech: Silently imagining the command words without any articulatory muscle movement. - Command Words: - Movement: “Left”, “Right”, “Up” - Actions: “Pick”, “Push” - Interaction Process: 1. Participants pressed the spacebar to indicate readiness. 2. The screen turned black for 2 seconds to prepare input. 3. A fixation cross appeared, signalling participants to speak or imagine the desired command. 4. The fixation cross disappeared, and the robot’s position updated accordingly. 5. The robot always performed the correct action, ensuring participants were stress-free. - Session Organisation: - Four parts: Overt Speech, Imagined Speech, Overt Speech, Imagined Speech. - 80 repetitions per word and paradigm (400 imagined, 400 spoken per participant). - Task divided into levels of 25 interactions to reduce cognitive load. - Breaks between sessions allowed for rest and EEG headset impedance checks. ## Participants - Subjects: 15 healthy individuals (11 male, 4 female), average age 26.8 years. - Attributes: Right-handed, fluent in English (non-native). - Ethics: Informed consent obtained; approved by the ethical review board of the Faculty of Mathematics and Computer Science, Saarland University. --- # Recording Conditions - Environment: Dimly lit room with minimal distractions. - EEG Equipment: Wireless 64-channel Brain Products Live Amp 64 system. - Sampling rate: 500 Hz. - Electrode placement: 10-20 International System. - Synchronisation: The robot game and EEG recording software were executed on the same computer. --- # Data Format - File Format: .fif format, containing a continuous raw data stream with event markers. - Event Dictionary: ```json { "Event_Dictionary": { "Empty": 1, "EndOfEvent": 2, "EndOfLevel": 3, "EndOfParadigm": 4, "space_bar": 5, "Overt_Up": 11, "Overt_Left": 12, "Overt_Right": 13, "Overt_Pick": 14, "Overt_Push": 15, "Silent_Up": 21, "Silent_Left": 22, "Silent_Right": 23, "Silent_Pick": 24, "Silent_Push": 25 } }

관련 논문 1편

Gramophone Recording Noise Dataset

GRND
GRND 설명 보기

Dataset of noise segments extracted from gramophone recordings. It contains 139 min of noises, divided into 2430 segments from 1386 different recordings, dated between 1902 and 1966.

관련 논문 1편

GUITAR-FX-DIST: A Dataset of Processed Guitar Recordings for Music Research - (Mono Continuous)

GUITAR-FX-DIST: A Dataset of Processed Guitar Recordings for Music Research - (Mono Continuous) 설명 보기

GUITAR-FX-DIST is a dataset of electric guitar recordings processed with overdrive, distortion, and fuzz audio effects. It was developed for research in guitar effects detection, classification, and parameters estimation. The dataset is also useful for research on automatic music transcription, intelligent music production, signal processing, or effects modelling. It contains both unprocessed and processed recordings. The dataset is split into 4 sub-datasets: Mono Continuous, Mono Discrete, Poly Continuous, Poly Discrete Authors: Marco Comunità - Centre for Digital Music, Queen Mary University of London Reference: If you make use of GUITAR-FX-DIST, please cite the following publication: @article{comunita2020guitar, title={Guitar Effects Recognition and Parameter Estimation with Convolutional Neural Networks}, author={Comunit{\`a}, Marco and Stowell, Dan and Reiss, Joshua D}, journal={arXiv preprint arXiv:2012.03216}, year={2020} }

관련 논문 1편

GUITAR-FX-DIST: A Dataset of Processed Guitar Recordings for Music Research - (Mono Discrete)

GUITAR-FX-DIST: A Dataset of Processed Guitar Recordings for Music Research - (Mono Discrete) 설명 보기

GUITAR-FX-DIST is a dataset of electric guitar recordings processed with overdrive, distortion and fuzz audio effects. It was developed for research in guitar effects detection, classification and parameters estimation. The dataset is also useful for research on automatic music transcription, intelligent music production, signal processing or effects modelling. It contains both unprocessed and processed recordings. The dataset is split into 4 sub-datasets: Mono Continuous, Mono Discrete, Poly Continuous, Poly Discrete Authors: Marco Comunità - Centre for Digital Music, Queen Mary University of London Reference: If you make use of GUITAR-FX-DIST, please cite the following publication: @article{comunita2020guitar, title={Guitar Effects Recognition and Parameter Estimation with Convolutional Neural Networks}, author={Comunit{\`a}, Marco and Stowell, Dan and Reiss, Joshua D}, journal={arXiv preprint arXiv:2012.03216}, year={2020} }

관련 논문 1편

GUITAR-FX-DIST: A Dataset of Processed Guitar Recordings for Music Research - (Poly Continuous)

GUITAR-FX-DIST: A Dataset of Processed Guitar Recordings for Music Research - (Poly Continuous) 설명 보기

GUITAR-FX-DIST is a dataset of electric guitar recordings processed with overdrive, distortion and fuzz audio effects. It was developed for research in guitar effects detection, classification and parameters estimation. The dataset is also useful for research on automatic music transcription, intelligent music production, signal processing or effects modelling. It contains both unprocessed and processed recordings. The dataset is split into 4 sub-datasets: Mono Continuous, Mono Discrete, Poly Continuous, Poly Discrete Authors: Marco Comunità - Centre for Digital Music, Queen Mary University of London Reference: If you make use of GUITAR-FX-DIST, please cite the following publication: @article{comunita2020guitar, title={Guitar Effects Recognition and Parameter Estimation with Convolutional Neural Networks}, author={Comunit{\`a}, Marco and Stowell, Dan and Reiss, Joshua D}, journal={arXiv preprint arXiv:2012.03216}, year={2020} }

관련 논문 1편

GUITAR-FX-DIST: A Dataset of Processed Guitar Recordings for Music Research - (Poly Discrete)

GUITAR-FX-DIST: A Dataset of Processed Guitar Recordings for Music Research - (Poly Discrete) 설명 보기

GUITAR-FX-DIST is a dataset of electric guitar recordings processed with overdrive, distortion and fuzz audio effects. It was developed for research in guitar effects detection, classification and parameters estimation. The dataset is also useful for research on automatic music transcription, intelligent music production, signal processing or effects modelling. It contains both unprocessed and processed recordings. The dataset is split into 4 sub-datasets: Mono Continuous, Mono Discrete, Poly Continuous, Poly Discrete Authors: Marco Comunità - Centre for Digital Music, Queen Mary University of London Reference: If you make use of GUITAR-FX-DIST, please cite the following publication: @article{comunita2020guitar, title={Guitar Effects Recognition and Parameter Estimation with Convolutional Neural Networks}, author={Comunit{\`a}, Marco and Stowell, Dan and Reiss, Joshua D}, journal={arXiv preprint arXiv:2012.03216}, year={2020} }

관련 논문 1편

Joint EEG-fMRI recording during affective music listening

Joint EEG-fMRI recording during affective music listening 설명 보기

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

관련 논문 1편

Scores given by LLM according to preassigned score

LLM evaluation scores
LLM evaluation scores 설명 보기

Dataset is a CSV file, that contains evaluation scores given by a panel of LLMs to responses produced by other LLMs . Responses regard a forecasting task assigned to multiple LLMs. The evaluation of the individual forecasts are performed according to 9 criteria indicated in the prompt. (see for details https://arxiv.org/abs/2412.09385). Data are organised as follows. Each row in the dataset represents a forecast evaluation. In columns: the forecaster number; marks for each criterium; mean of the marks; Arena score of the evaluator LLM (as per July 12, 2024). Scores can be further elaborated to evaluate the ability of LLM panels to assess forecasts. For example you can compute Intraclass Correlation Coefficients (ICC) to evaluate consistency and coherence of the panel evaluation. You can also process marks according to classical statistics or ranking evaluation algorithms (e.g. Kendall distance) or formation of optimized subsets. We also provide apps to upload the dataset, filter the data, compute ICC values, and visualize the results through heatmaps.

관련 논문 1편

Maintenance of Wakefulness Test (MWT) recordings

Maintenance of Wakefulness Test (MWT) recordings 설명 보기

Maintenance of Wakefulness Test (MWT) is a dataset of recordings with microsleep episodes and drowsiness. Cite as: Hertig-Godeschalk Anneke, Skorucak Jelena, Malafeev Alexander, Achermann Peter, Mathis Johannes, & Schreier David R. (2019). Maintenance of Wakefulness Test (MWT) recordings (Version v1) [Data set]. Zenodo. http://doi.org/10.5281/zenodo.325171 Each file contains a MWT trial (first trial after noon) recording of a patient. The data contains occipital EEG and EOG data. All signals were bandpass filtered between 0.5-45 Hz. In each file, the data is structured as the following: fs: sampling rate. eeg_O1: EEG channel O1-M2 where M2 is the mastoid electrode on the opposite side. eeg_O2: EEG channel O2-M1 where M1 is the mastoid electrode on the opposite side. E1 and E2: EOG channels for left and right eye, both referenced to M1. labels_O1 and labels_O2: arrays with expert scoring (0-wake, 1-MSE, 2-MSEc, 3-ED, according to the BERN scoring criteria published in Hertig-Godeschalk et al. doi:10.1093/sleep/zsz163.); length of the arrays is the same as for other signals, i.e. there is a label per sample. prec: amount of signal samples per label, in this case it is 1. variables prec and half_prec were not used. num_Labels: length of the signal in samples. Further descriptions, details, and outcomes can be found in the related studies. The published studies which are based on this data and address the borderland between wakefulness and sleep, i.e. microsleep episodes, are listed under related/alternative identifiers.

관련 논문 1편

OSASUD: A dataset of stroke unit recordings for the detection of Obstructive Sleep Apnea Syndrome

OSASUD
OSASUD 설명 보기

Polysomnography (PSG) is a fundamental diagnostical method for the detection of Obstructive Sleep Apnea Syndrome (OSAS). Historically, trained physicians have been manually identifying OSAS episodes in individuals based on PSG recordings. Such a task is highly important for stroke patients, since in such cases OSAS is linked to higher mortality and worse neurological deficits. Unfortunately, the number of strokes per day vastly outnumbers the availability of polysomnographs and dedicated healthcare professionals. The data in this work pertains to 30 patients that were admitted to the stroke unit of the Udine University Hospital, Italy. Unlike previous studies, exclusion criteria are minimal. As a result, data are strongly affected by noise, and individuals may suffer from several comorbidities. Each patient instance is composed of overnight vital signs data deriving from multi-channel ECG, photoplethysmography and polysomnography, and related domain expert’s OSAS annotations. The dataset aims to support the development of automated methods for the detection of OSAS events based on just routinely monitored vital signs, and capable of working in a real-world scenario.

관련 논문 1편

Guinea baboon vocalizations dataset automatically extracted with a deep neural network from natural audio recordings

PapioVoc
PapioVoc 설명 보기

Abstract The data collection process consisted of continuously recording during one month a group of Guinea baboons living in semi-liberty at the CNRS primatology center in Rousset-sur-Arc (France). Two microphones we placed nearby their enclosure to continuously record the sounds produced by the group. A convolutional neural network (CNN) was used on these large and noisy audio recordings to automatically extract segments of sound containing a baboon vocal production by following the method of Bonafos et al. (2023). The resulting dataset consists of one-second to several-minute wav files of automatically detected vocalizations segments. The dataset thus provides a wide range of baboon vocalizations produced at all times of the day. It can be used to study vocal productions of non-human primates, their repertoire, their distribution over the day, their frequency, and their heterogeneity. In addition to the analysis of animal communication, the dataset can also be used as a learning base for sound classification models. Data acquisition The data are audio recordings of baboons. The recordings were made with a H6 Zoom recorder, using the included XYH-6 stereo microphone. The sample size is 44100 Hertz, 16 bits. The microphones were placed in the vicinity of the enclosure for one month and recorded continuously on a PC computer. A CNN passed over the data with a sliding window of 1 second and an overlap of 80% to detect the vocal productions of the baboons. The dataset consists of the segments predicted by the CNN to contain a baboon vocalization. Windows containing signal less than one second apart were merged into a single vocalization. Data source location Institution: CNRS, Primate Facility City/Town/Region: Rousset-sur-Arc Country: France Latitude and longitude for collected samples/data: 43.47033535251509, 5.6514732876668905 Value of the data This dataset is relatively unique in terms of the quantity of vocalizations available. This massive dataset can be very useful to two types of scientific communities: experts in primatology who study the vocal productions of non-human primates, and experts in data science and audio signal processing. The machine learning research community has at its disposal a database of several dozen hours of animal vocalizations, which will make it possible to build up a large learning base, very useful for Environemental Sound Recognition tasks, for example. Objective This dataset is a follow-up of two studies on the vocal productions of Guinea baboons (Papio papio) in which we carried out analyses of their vocal productions on the basis of a relatively large vocalization sample containing around 1300 vocalizations (Boë, Berthommier, Legou, Captier, Kemp, Sawallis, Becker, Rey, & Fagot, 2017; Kemp, Rey, Legou, Boë, Berthommier, Becker, & Fagot, 2017). The aim was to collect a larger database using the technique of deep convolutional neural networks in order to 1) automatically detect vocal productions in a large continuous audio recording and 2) perform a categorization of these vocalizations on a more massive sample. A description of the pipeline that enabled these automatic detections and categorizations is given in Bonafos, Pudlo, Freyermuth, Legou, Fagot, Tronçon, & Rey (2023). Data description The data is a set of audio files in wav format. They are at least one second long (the size of the window), up to several minutes, if several windows are consecutively predicted as containing signal. Moreover, we add the labeled data we used to train the CNN which did the prediction. We also provide two hours of the continuous recordings to have an idea of the continuous recordings and test the code of the paper provided on gitlab. In addition, there is a database in csv format listing all the vocalizations, the day and time of their production, and the prediction probabilities of the model. Experimental design, materials and methods The original recordings represent one month of continuous audio recording. Seven hours of this month were manually labelled. They were segmented and labelled according to whether or not there was a monkey vocalization (i.e., noise or vocalization) and, if there was a vocalization, according to the type of vocalization (6 possible classes: bark, copulation grunt, grunt, scream, yak, wahoo). These manually labelled data were used as a training set for a CNN, which was automatically trained following the pipeline of Bonafos et al. (2023). This model was then used to automatically detect and classify vocalization during the whole month of audio recording. It processes the data in the same way when predicting new data as it does when training. It uses a sliding window of one second with an overlap of 80%. It does not take into account information from previous predictions, but calculates the probability of a vocalization in each one-second window independently. It then iterates through the month. For each window, the model predicts two outputs: the probability that there is a vocalization and the probability of each class of vocalization. For the purpose of generating the wav files, if a window has a probability of a vocalization greater than 0.5, it is considered to contain a vocalization. If it is the first one, a vocalization is started at that moment. If the time windows that follow a vocalization also contain a vocalization, then the signal they contain is added to the first segment for which a vocalization has been detected. As soon as a one-second segment no longer contains a signal corresponding to a vocalization, the wav file is closed. If windows are predicted to contain no vocalizations, but are between two windows that contain vocalizations within 1 second of each other, then all windows are merged.

관련 논문 1편

Parkinson Speech Dataset with Multiple Types of Sound Recordings Data Set

Parkinson Speech Dataset with Multiple Types of Sound Recordings Data Set 설명 보기

The PD database consists of training and test files. The training data belongs to 20 PWP (6 female, 14 male) and 20 healthy individuals (10 female, 10 male) who appealed at the Department of Neurology in Cerrahpasa Faculty of Medicine, Istanbul University. From all subjects, multiple types of sound recordings (26 voice samples including sustained vowels, numbers, words and short sentences) are taken. A group of 26 linear and time'“frequency based features are extracted from each voice sample. UPDRS ((Unified Parkinson's Disease Rating Scale) score of each patient which is determined by expert physician is also available in this dataset. Therefore, this dataset can also be used for regression. After collecting the training dataset which consists of multiple types of sound recordings and performing our experiments, in line with the obtained findings we continued collecting an independent test set from PWP via the same physician's examination process under the same conditions. During the collection of this dataset, 28 PD patients are asked to say only the sustained vowels 'a' and 'o' three times respectively which makes a total of 168 recordings. The same 26 features are extracted from voice samples of this dataset. This dataset can be used as an independent test set to validate the results obtained on training set.

관련 논문 1편

Dataset for the paper "On Automatic Parsing of Log Records"

Synthetic and Real Apache Log Records
Synthetic and Real Apache Log Records 설명 보기

Each file contains a specific dataset described in the paper "On Automatic Parsing of Log Records". For example, T_E.txt contains the data for the dataset $T_E$. In a file, each log string resides on a separate line and contains a 2-tuple separated by tab (\t). The first element of the tuple is the actual log string that has to be parsed. The second element is the corresponding “translation” specifying the field name for each of the characters of the first element.

관련 논문 1편

MOSQUITO WINGBEAT RECORDINGS

WINGBEATS
WINGBEATS 설명 보기

Context The database contains wav recordings from the same optical sensor inserted in-turn into six insectary boxes containing only one mosquito species of both sexes (about 200-300 flying mosquitoes in each cage). As the mosquitoes fly randomly through the sensor their wingbeat partially occludes the light from the transmitter to the receiver. The light fluctuation recorded is modulated by the wingbeat of the insect. The resulting signal is pseudo-acoustic, meaning that it sounds exactly like a microphone recording but has been acquired using optical means (however, not vision based). Insect Biometrics, in the context of our work, is a measurable behavioral characteristic of flying insects. Biometric identifiers are related to the shape of the body (main body size, wing shape, wingbeat frequency, pattern movement of the wings). Biometric identification methods use biometric characteristics or traits to verify species/sex identities when insects access endpoint traps following a bait. Content • 279,566 wingbeat recordings correctly labeled • 6 mosquito species (Ae. aegypti, Ae. albopictus, An. arabiensis, An. gambiae, Cu. pipiens, Cu. quinquefasciatus) • 3 genera of mosquito species (Aedes, Anopheles, Culex) Acknowledgements The data have been recorded at the premises of Biogents, Regensburg, Germany (https://www.biogents.com/) and with the help of IRIDEON SA, Spain (http://irideon.eu/ ). The data have been recorded using the device published in: Potamitis I. and Rigakis I., "Large Aperture Optoelectronic Devices to Record and Time-Stamp Insects’ Wingbeats," in IEEE Sensors Journal, vol. 16, no. 15, pp. 6053-6061, Aug.1, 2016. doi: 10.1109/JSEN.2016.2574762 The REMOSIS project that supported the creation of the database has received funding from the European Union’s Horizon 2020 research and innovation program under grant agreement No 691131. We gratefully acknowledge the support of NVIDIA Corporation with the donation of a TITAN-X GPU used for training the deep learning networks used to classify mosquitoes’ spectra. Inspiration The point of having such recordings is to eventually embed optoelectronic sensors in automatic traps that will report counts, species and sex identity of captured mosquitoes. All species of this dataset can be dangerous as they are potential vectors of pathogens that cause serious illnesses. A widespread network of traps for insects of economic importance such as fruit flies and of hygienic importance such as mosquitoes allows the automatic creation of spatiotemporal maps and cuts down significantly the manual cost of visiting the traps. The creation of historical data can lead to the prediction of outbreaks and risk assessment in general. We provide code to read the data and extract the power spectral density signature of each wingbeat. We also extract Mel-scaled, filter-bank features. How about wavelets and time-varying autoregressive models? The starter code using top-tier shallow classifiers achieves a mean accuracy of 81-84%. Deep-learning performs better. Can you classify genus, perform clustering, apply transfer learning to spectral data? Come aboard and help humanity against killer mosquitoes!

관련 논문 1편

https://zenodo.org/record/2552025/export/json#.Y2FhyXbMK5c

https://zenodo.org/record/2552025/export/json#.Y2FhyXbMK5c 설명 보기

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

관련 논문 1편

https://zenodo.org/records/13495922

https://zenodo.org/records/13495922 설명 보기

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

관련 논문 1편

https://zenodo.org/records/7495109

https://zenodo.org/records/7495109 설명 보기

Click to add a brief description of the dataset (Markdown and LaTeX enabled). Provide: * a high-level explanation of the dataset characteristics * explain motivations and summary of its content * potential use cases of the dataset

관련 논문 0편

https://zenodo.org/record/8210563

VIDIMU: Multimodal video and IMU kinematic dataset on daily life activities using affordable devices
VIDIMU: Multimodal video and IMU kinematic dataset on daily life activities using affordable devices 설명 보기

Human activity recognition and clinical biomechanics are challenging problems in physical telerehabilitation medicine. However, most publicly available datasets on human body movements cannot be used to study both problems in an out-of-the-lab movement acquisition setting. The objective of the VIDIMU dataset is to pave the way towards affordable patient tracking solutions for remote daily life activities recognition and kinematic analysis. The VIDIMU dataset includes 54 healthy young adults that were recorded on video and 16 of them were simultaneously recorded using custom IMUs. For each subject, 13 activities were registered using a low-resolution video camera and five Inertial Measurement Units (IMUs). Inertial sensors were placed in the lower or the upper limbs of the subject, respectively for activities that involve movement with the lower or the upper body. Video recordings were postprocessed using the state-of-the-art pose estimator BodyTrack (similar to OpenPose, and included in NVIDIA Maxine-AR-SDK) to provide a sequence of 3D joint positions for each movement. Raw IMU recordings were post-processed to compute joint angles by inverse kinematics with OpenSim. For recordings including simultaneous acquisition of video and IMU data types, these signals were used for data file synchronization. Collected data can be further used in applications related to human activity recognition and biomechanics related experiments in simulated home-like settings.