Leveraging Pre-trained AudioLDM for Sound Generation: A Benchmark Study
원문 초록
Deep neural networks have recently achieved breakthroughs in sound generation. Despite the outstanding sample quality, current sound generation models face issues on small-scale datasets (e.g., overfitting), significantly limiting performance. In this paper, we make the first attempt to investigate the benefits of pre-training on sound generation with AudioLDM, the cutting-edge model for audio generation, as the backbone. Our study demonstrates the advantages of the pre-trained AudioLDM, especially in data-scarcity scenarios. In addition, the baselines and evaluation protocol for sound generation systems are not consistent enough to compare different studies directly. Aiming to facilitate further study on sound generation tasks, we benchmark the sound generation task on various frequently-used datasets. We hope our results on transfer learning and benchmarks can provide references for further research on conditional sound generation.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Benchmarking Deep Learning and Vision Foundation Models for Atypical vs. Normal Mitosis Classification with Cross-Dataset Evaluation
Benchmarking histopathology foundation models in a multi-center dataset for skin cancer subtyping
The Catechol Benchmark: Time-series Solvent Selection Data for Few-shot Machine Learning
Disentangling coincident cell events using deep transfer learning and compressive sensing
Calibrated and Robust Foundation Models for Vision-Language and Medical Image Tasks Under Distribution Shift
Generalizing Vision-Language Models to Novel Domains: A Comprehensive Survey
토론
이 논문과 연결된 포럼 글이 아직 없습니다.