Representative Subset Selection for Efficient Fine-Tuning in Self-Supervised Speech Recognition
원문 초록
Self-supervised speech recognition models require considerable labeled training data for learning high-fidelity representations for Automatic Speech Recognition (ASR) which is computationally demanding and time-consuming. We consider the task of identifying an optimal subset of data for efficient fine-tuning in self-supervised speech models for ASR. We discover that the dataset pruning strategies used in vision tasks for sampling the most informative examples do not perform better than random subset selection on fine-tuning self-supervised ASR. We then present the COWERAGE algorithm for representative subset selection in self-supervised ASR. COWERAGE is based on our finding that ensuring the coverage of examples based on training Word Error Rate (WER) in the early training epochs leads to better generalization performance. Extensive experiments with the wav2vec 2.0 and HuBERT model on TIMIT, Librispeech, and LJSpeech datasets show the effectiveness of COWERAGE and its transferability across models, with up to 17% relative WER improvement over existing dataset pruning methods and random sampling. We also demonstrate that the coverage of training instances in terms of WER values ensures the inclusion of phonemically diverse examples, leading to better test accuracy in self-supervised speech recognition models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Addressing Pitfalls in Auditing Practices of Automatic Speech Recognition Technologies: A Case Study of People with Aphasia
Unsupervised Rhythm and Voice Conversion to Improve ASR on Dysarthric Speech
Towards Temporally Explainable Dysarthric Speech Clarity Assessment
Vedavani: A Benchmark Corpus for ASR on Vedic Sanskrit Poetry
BeaverTalk: Oregon State University's IWSLT 2025 Simultaneous Speech Translation System
Exploring Generative Error Correction for Dysarthric Speech Recognition
토론
이 논문과 연결된 포럼 글이 아직 없습니다.