Multimodal PISA
Dataset for multimodal skills assessment focusing on assessing piano player’s skill level. Annotations include player's skills level, and song difficulty level. Bounding box annotations around pianists' hands are also provided.
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Audio Classification is a machine learning task that involves identifying and tagging audio signals into different classes or categories. The goal of audio classification is to enable machines to automatically recognize and distinguish between different types of audio, such as music, speech, and environmental sounds.
출처에 같은 태스크 이름으로 연결된 데이터셋입니다. 동명 태스크가 포함될 수 있으므로, 비교할 때는 평가 결과의 조건도 확인하세요.
Dataset for multimodal skills assessment focusing on assessing piano player’s skill level. Annotations include player's skills level, and song difficulty level. Bounding box annotations around pianists' hands are also provided.
PC-GITA is a Spanish speech corpus designed to analyze speech impairments in individuals with Parkinson's Disease (PD). - 100 participants: 50 with PD, 50 healthy controls (age- and gender-matched). - Recorded in noise-controlled conditions with high-quality equipment. - Tasks include: sustained vowels, syllable repetitions, reading, and monologues. Use Cases: 1. Speech disorder detection using machine learning. 2. PD progression monitoring via speech analysis. Source: "New Spanish speech corpus database for the analysis of people suffering from Parkinson’s disease" by J.R. Orozco-Arroyave et al.
The full version of ReefSet used in Williams et al. (2024). This dataset contains strongly labeled audio clips from coral reef habitats, taken across 16 unique datasets from 11 countries. This dataset can be used to test transfer learning performance of audio embedding models. This folder includes: - 57,084 WAV files that make up ReefSet_v1.0. Each file is 1.88 seconds in length, sampled at 16 kHz. All files have an associated label. - reefset_annotations.json, which contains the associated label, file ID, filename, data sharer, dataset and recorder type used for each sample in ReefSet_v1.0. This information is also indicated in the filename of each file. - 'reefset_labels_by_dataset.csv' provides a table containing the counts of each label class within each dataset.
Asthma is a common, usually long-term respiratory disease with negative impact on society and the economy worldwide. Treatment involves using medical devices (inhalers) that distribute medicationto the airways, and its efficiency depends on the precision of the inhalation technique. Health monitoring systems equipped with sensors and embedded with sound signal detection enable the recognition of drug actuation and could be powerful tools for reliable audio content analysis. The RDA Suite includes a set of tools for audio processing, feature extraction and classification and is provided along with a dataset consisting of respiratory and drug actuation sounds. The classification models in RDA are implemented based on conventional and advanced machine learning and deep network architectures. This study provides a comparative evaluation of the implemented approaches, examines potential improvements and discusses challenges and future tendencies. The central aim of this research is to identify associations between high-level classification labels and low-level features extracted from audio clips of different semantic activities. We investigate the clinical applicability of different audio-based signal processing methods for assessing medication adherence. The dataset consists of recordings acquired in anacoustically controlled setting, free of ambient indoor environment noise, at the University of Patras. Three subjects, who were familiar with the inhaler technique, participated in the study. The participants were instructed to use the inhaler, as typically performed in a clinical procedure. Foreach and every participant informed consent was obtained.During breathing and drug actuation, the audio signals were acquired by a microphone attached to the inhalation de-vice, communicating with a mobile phone via Bluetooth.The addition of the adherence monitoring device did not impact the normal functioning of the inhaler, which had afull placebo canister. In total, 370 audio files were recorded with a different duration each, containing an entire inhaleruse case, with respiratory flow ranging on 180-240 L/min.Each audio recording was sampled with a 8KHz sampling frequency, as a mono channel WAV file, at 8-bit depth.The audio recordings were segmented and annotated by a human specialist into inhaler actuation, exhalation, inhalationand environmental noise. The obtained segments (of non-mixed states) were of variable length and, for some methods, were further segmented into frames of fixed length for the purposes of feature extraction.The constructed database overall consisted of 193 drug actuation segments, 319 inhalation and 620 exhalation segments and 505 noise segments, ready to be used for audio sound recognition using different sets of features.
arxiv : https://arxiv.org/abs/2304.11708 Accepted at 29th International Congress on Sound and Vibration (ICSV29). The drone has been used for various purposes including military applications, aerial photography, and pesticide spraying. However, the drone is vulnerable to external disturbances, and malfunction in propellers and motors can easily occur. To improve the safety of drone operations, early detection of mechanical faults should be made in real-time. In this paper, we propose a sound-based deep neural network (DNN) fault classifier and drone sound dataset. The dataset was constructed by collecting the operating sounds of drones from microphones mounted on three different drones in an anechoic chamber. The dataset includes various operating conditions of drones, such as flight directions (front, back, right, left, clockwise, counter clockwise) and faults on propellers and motors. The drone sounds were then mixed with noises recorded in five different spots on the university campus, with a signal-to-noise ratio (SNR) varying from 10 dB to 15 dB. Using the acquired dataset, we train a DNN classifier, 1DCNN-ResNet, that classifies the types of mechanical faults and their locations from short-time input waveforms. We employ multitask learning (MTL) and incorporate the direction classification task as an auxiliary task to make the classifier learn more general audio features. The test over unseen data reveals that the proposed multitask model can successfully classify faults in drones and outperforms single-task models even with less training data. please reorganize the file directory like below drone ㄴA ㄴB ㄴC For each drone type A, B, and C have 54000*2 files. (Here, *2 means stereo channel, you can find mic1 and mic2 in subdirectory) They are divided into train, valid, and test by a 6:2:2 ratio. For each file, recording information is labeled below. {model_type}{maneuvering_direction}{fault}{drone_file_index}{background}{background_file_index}{SNR} model_type: A, B, C maneuvering_direction: F(Front), B(Back), R(Right), L(Left), C(Clockwise), CC(Counter-clockwise) fault: N (Normal), MF14 (Moter Failure), PC14 (Propeller Cut) -> 1~4 means each motor/propeller of the quadcopter. Dataset available under below "Homepage" ↓
The Humbug Zooinverse dataset is a dataset of mosquito audio recordings. With over a thousand contributors, it contains 195,434 labels of two second duration, of which approximately 10 percent signify mosquito events. Source: https://github.com/HumBug-Mosquito/ZooniverseData
├── data/ │ ├── 00094903-4dbf-44a9-bf09-698fc361dbff.wav │ └── … ├── development.csv └── test.csv * .wav files: mono, 44.1 kHz, 32‑bit float * .csv files: meta-data for all tasks, linkable to wav files with id ## Usage Visit the dedicated code repository: https://github.com/DEAR-dataset/code ## Source Data * Speech monologues (proprietary anechoic recordings) * HOA‑SSR library ambisonics scenes (licensed via FORCE Technology) * Impulse responses for controlled reverberation ## Citation If you use DEAR in your research, please cite: bibtex @inproceedings{ groeger2025dear, author={Gröger, Fabian and Baumann, Pascal and Amruthalingam, Ludovic and Simon, Laurent and Giurda, Ruksana and Lionetti, Simone}, booktitle={ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)}, title={Evaluation of Deep Audio Representations for Hearables}, year={2025}, doi={10.1109/ICASSP49660.2025.10887737} } ArXiv version: arxiv.org/abs/2502.06664Sharp, Used, Dulled * Evaluation: Accuracies, Precision, Recal, F1-score, ROC curve * Each tool's wear is categorized sequentially: Sharp → Used → Dulled. * The dataset includes measurements from ten tools: T1 to T10. * Data splitting options include random or chronological distribution, without shuffling. * Options: * Original data or Augmented data * Random distribution or Tool Distribution ## Use Cases: | Input | Model | Output | |-----------------|---------------|-----------------------| | Use Cases: | | | | 4 Images (1 Tool Image, 3 Spectrograms (X, Y, Z)) | Classification Model | Class (Flank Tool Wear: Sharp, Used, Dulled) | | 3 Spectrograms (X,Y,Z axis) | Classification Model | Class (Flank Tool Wear) | | 1 Tool Image | Classification Model | Image Class (Flank Tool Wear) | | Future Work: | | | | [1, ..., 4] Images | Model | Remaining Useful Life (RUL) estimation | | [1, ..., 4] Images | Monitoring Model | Fault and Anomaly Detection | | [1, ..., 4] Images | Forecasting Model | Multivariate Time Series Prediction | | [1, ..., 3] Spectrograms | Model | Signal Drift measurement | | [1, ..., 4] Images | Regression Model | Zero-Shot Flank Tool Wear (in µm, 10e-6 meter) | | [1, ..., 4] Images | Feature Engineering | Diagnostic Feature Designer If you use Mudestreda dataset cite the work Minape @ ICONIP2023. ## Cite the Paper: If you reference the papr or you use Mudestreda dataset cite the work Minape @ ICONIP2023 @inproceedings{truchan2023multimodal, title={Multimodal Isotropic Neural Architecture with Patch Embedding}, author={Truchan, Hubert and Naumov, Evgenii and Abedin, Rezaul and Palmer, Gregory and Ahmadi, Zahra}, booktitle={International Conference on Neural Information Processing}, pages={173--187}, year={2023}, organization={Springer} }출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.