Papers with Code 아카이브

Audio Classification

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

하위 태스크
4
평가표
26
보존된 평가 기록
199

Audio Classification is a machine learning task that involves identifying and tagging audio signals into different classes or categories. The goal of audio classification is to enable machines to automatically recognize and distinguish between different types of audio, such as music, speech, and environmental sounds.

데이터셋

출처에 같은 태스크 이름으로 연결된 데이터셋입니다. 동명 태스크가 포함될 수 있으므로, 비교할 때는 평가 결과의 조건도 확인하세요.

Multimodal PISA

Dataset for multimodal skills assessment focusing on assessing piano player’s skill level. Annotations include player's skills level, and song difficulty level. Bounding box annotations around pianists' hands are also provided.

PC-GITA

PC-GITA is a Spanish speech corpus designed to analyze speech impairments in individuals with Parkinson's Disease (PD). - 100 participants: 50 with PD, 50 healthy controls (age- and gender-matched). - Recorded in noise-controlled conditions with high-quality equipment. - Tasks include: sustained vowels, syllable repetitions, reading, and monologues. Use Cases: 1. Speech disorder detection using machine learning. 2. PD progression monitoring via speech analysis. Source: "New Spanish speech corpus database for the analysis of people suffering from Parkinson’s disease" by J.R. Orozco-Arroyave et al.

ReefSet

The full version of ReefSet used in Williams et al. (2024). This dataset contains strongly labeled audio clips from coral reef habitats, taken across 16 unique datasets from 11 countries. This dataset can be used to test transfer learning performance of audio embedding models. This folder includes: - 57,084 WAV files that make up ReefSet_v1.0. Each file is 1.88 seconds in length, sampled at 16 kHz. All files have an associated label. - reefset_annotations.json, which contains the associated label, file ID, filename, data sharer, dataset and recorder type used for each sample in ReefSet_v1.0. This information is also indicated in the filename of each file. - 'reefset_labels_by_dataset.csv' provides a table containing the counts of each label class within each dataset.

RESPIRATORY AND DRUG ACTUATION DATASET

Asthma is a common, usually long-term respiratory disease with negative impact on society and the economy worldwide. Treatment involves using medical devices (inhalers) that distribute medicationto the airways, and its efficiency depends on the precision of the inhalation technique. Health monitoring systems equipped with sensors and embedded with sound signal detection enable the recognition of drug actuation and could be powerful tools for reliable audio content analysis. The RDA Suite includes a set of tools for audio processing, feature extraction and classification and is provided along with a dataset consisting of respiratory and drug actuation sounds. The classification models in RDA are implemented based on conventional and advanced machine learning and deep network architectures. This study provides a comparative evaluation of the implemented approaches, examines potential improvements and discusses challenges and future tendencies. The central aim of this research is to identify associations between high-level classification labels and low-level features extracted from audio clips of different semantic activities. We investigate the clinical applicability of different audio-based signal processing methods for assessing medication adherence. The dataset consists of recordings acquired in anacoustically controlled setting, free of ambient indoor environment noise, at the University of Patras. Three subjects, who were familiar with the inhaler technique, participated in the study. The participants were instructed to use the inhaler, as typically performed in a clinical procedure. Foreach and every participant informed consent was obtained.During breathing and drug actuation, the audio signals were acquired by a microphone attached to the inhalation de-vice, communicating with a mobile phone via Bluetooth.The addition of the adherence monitoring device did not impact the normal functioning of the inhaler, which had afull placebo canister. In total, 370 audio files were recorded with a different duration each, containing an entire inhaleruse case, with respiratory flow ranging on 180-240 L/min.Each audio recording was sampled with a 8KHz sampling frequency, as a mono channel WAV file, at 8-bit depth.The audio recordings were segmented and annotated by a human specialist into inhaler actuation, exhalation, inhalationand environmental noise. The obtained segments (of non-mixed states) were of variable length and, for some methods, were further segmented into frames of fixed length for the purposes of feature extraction.The constructed database overall consisted of 193 drug actuation segments, 319 inhalation and 620 exhalation segments and 505 noise segments, ready to be used for audio sound recognition using different sets of features.

Sound-based drone fault classification using multitask learning

arxiv : https://arxiv.org/abs/2304.11708 Accepted at 29th International Congress on Sound and Vibration (ICSV29). The drone has been used for various purposes including military applications, aerial photography, and pesticide spraying. However, the drone is vulnerable to external disturbances, and malfunction in propellers and motors can easily occur. To improve the safety of drone operations, early detection of mechanical faults should be made in real-time. In this paper, we propose a sound-based deep neural network (DNN) fault classifier and drone sound dataset. The dataset was constructed by collecting the operating sounds of drones from microphones mounted on three different drones in an anechoic chamber. The dataset includes various operating conditions of drones, such as flight directions (front, back, right, left, clockwise, counter clockwise) and faults on propellers and motors. The drone sounds were then mixed with noises recorded in five different spots on the university campus, with a signal-to-noise ratio (SNR) varying from 10 dB to 15 dB. Using the acquired dataset, we train a DNN classifier, 1DCNN-ResNet, that classifies the types of mechanical faults and their locations from short-time input waveforms. We employ multitask learning (MTL) and incorporate the direction classification task as an auxiliary task to make the classifier learn more general audio features. The test over unseen data reveals that the proposed multitask model can successfully classify faults in drones and outperforms single-task models even with less training data. please reorganize the file directory like below drone ㄴA ㄴB ㄴC For each drone type A, B, and C have 54000*2 files. (Here, *2 means stereo channel, you can find mic1 and mic2 in subdirectory) They are divided into train, valid, and test by a 6:2:2 ratio. For each file, recording information is labeled below. {model_type}{maneuvering_direction}{fault}{drone_file_index}{background}{background_file_index}{SNR} model_type: A, B, C maneuvering_direction: F(Front), B(Back), R(Right), L(Left), C(Clockwise), CC(Counter-clockwise) fault: N (Normal), MF14 (Moter Failure), PC14 (Propeller Cut) -> 1~4 means each motor/propeller of the quadcopter. Dataset available under below "Homepage" ↓

DEAR

Dataset Summary The Deep Evaluation of Audio Representations (DEAR) dataset is a benchmark designed to assess general-purpose audio foundation models on properties critical for hearable devices. It comprises 1,158 mono audio tracks (30 s each), spatially mixing proprietary anechoic speech monologues with high-quality everyday acoustic scene recordings from the HOA‑SSR library. DEAR enables controlled evaluation of: * Context (environment type: domestic, leisure, nature, professional, transport; indoor/outdoor; stationary/transient noise) * Speech sources (speech presence detection; speaker count) * Acoustic properties (direct-to-reverberant ratio DRR, reverberation time RT60, signal‑to‑noise ratio SNR) All tracks are down‑mixed to a single channel at 44.1 kHz (32‑bit) and split into development and test sets with no overlap in speakers, backgrounds, or impulse responses. ## Tasks | Task Group | Task | Type | Metric | | ------------- | ----------------------------------- | ----------- | ----------- | | Context | 5‑way environment classification | Multi‑class | Matthews' $\phi$ | | | Indoor vs. outdoor | Binary | Matthews' $\phi$ | | | Stationary vs. transient noise | Binary | Matthews' $\phi$ | | Sources | Speech presence (1 s segments) | Binary | Matthews' $\phi$ | | | Speaker count (1 s segments) | Regression | $R^2$ | | Acoustics | DRR (1 s segments, 1 speaker) | Regression | $R^2$ | | | RT60 (1 s segments, 1 speaker) | Regression | $R^2$ | | | SNR (1 s segments, 1 speaker) | Regression | $R^2$ | | Retrospective | TUT2017 acoustic scene (15 classes) | Multi‑class | Matthews' $\phi$ | | | LibriCount speaker count (0–10) | Regression | $R^2$ | ## Dataset Structure ├── data/ │ ├── 00094903-4dbf-44a9-bf09-698fc361dbff.wav │ └── … ├── development.csv └── test.csv * .wav files: mono, 44.1 kHz, 32‑bit float * .csv files: meta-data for all tasks, linkable to wav files with id ## Usage Visit the dedicated code repository: https://github.com/DEAR-dataset/code ## Source Data * Speech monologues (proprietary anechoic recordings) * HOA‑SSR library ambisonics scenes (licensed via FORCE Technology) * Impulse responses for controlled reverberation ## Citation If you use DEAR in your research, please cite: bibtex @inproceedings{ groeger2025dear, author={Gröger, Fabian and Baumann, Pascal and Amruthalingam, Ludovic and Simon, Laurent and Giurda, Ruksana and Lionetti, Simone}, booktitle={ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)}, title={Evaluation of Deep Audio Representations for Hearables}, year={2025}, doi={10.1109/ICASSP49660.2025.10887737} } ArXiv version: arxiv.org/abs/2502.06664

Mudestreda

Mudestreda Multimodal Device State Recognition Dataset obtained from real industrial milling device with Time Series and Image Data for Classification, Regression, Anomaly Detection, Remaining Useful Life (RUL) estimation, Signal Drift measurement, Zero Shot Flank Took Wear, and Feature Engineering purposes. The official dataset used in the paper "Multimodal Isotropic Neural Architecture with Patch Embedding" ICONIP23. Official Minape repository: https://github.com/hubtru/Minape Official Mudestreda dataset: https://zenodo.org/records/8238653 Conference paper: https://link.springer.com/chapter/10.1007/978-981-99-8079-6_14 Mudestreda (MD) | Size 512 Samples (Instances, Observations)| Modalities 4 | Classes 3 | Future research: Regression, Remaining Useful Life (RUL) estimation, Signal Drift detection, Anomaly Detection, Multivariate Time Series Prediction, and Feature Engineering. ## Overview * Task: Uni/Multi-Modal Classification * Domain: Industrial Flank Tool Wear of the Milling Machine * Input (sample): 4 Images: 1 Tool Image, 3 Spectrograms (X, Y, Z axis) * Output: Machine state classes: Sharp, Used, Dulled * Evaluation: Accuracies, Precision, Recal, F1-score, ROC curve * Each tool's wear is categorized sequentially: Sharp → Used → Dulled. * The dataset includes measurements from ten tools: T1 to T10. * Data splitting options include random or chronological distribution, without shuffling. * Options: * Original data or Augmented data * Random distribution or Tool Distribution ## Use Cases: | Input | Model | Output | |-----------------|---------------|-----------------------| | Use Cases: | | | | 4 Images (1 Tool Image, 3 Spectrograms (X, Y, Z)) | Classification Model | Class (Flank Tool Wear: Sharp, Used, Dulled) | | 3 Spectrograms (X,Y,Z axis) | Classification Model | Class (Flank Tool Wear) | | 1 Tool Image | Classification Model | Image Class (Flank Tool Wear) | | Future Work: | | | | [1, ..., 4] Images | Model | Remaining Useful Life (RUL) estimation | | [1, ..., 4] Images | Monitoring Model | Fault and Anomaly Detection | | [1, ..., 4] Images | Forecasting Model | Multivariate Time Series Prediction | | [1, ..., 3] Spectrograms | Model | Signal Drift measurement | | [1, ..., 4] Images | Regression Model | Zero-Shot Flank Tool Wear (in µm, 10e-6 meter) | | [1, ..., 4] Images | Feature Engineering | Diagnostic Feature Designer If you use Mudestreda dataset cite the work Minape @ ICONIP2023. ## Cite the Paper: If you reference the papr or you use Mudestreda dataset cite the work Minape @ ICONIP2023 @inproceedings{truchan2023multimodal, title={Multimodal Isotropic Neural Architecture with Patch Embedding}, author={Truchan, Hubert and Naumov, Evgenii and Abedin, Rezaul and Palmer, Gregory and Ahmadi, Zahra}, booktitle={International Conference on Neural Information Processing}, pages={173--187}, year={2023}, organization={Springer} }

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.