Continual Learning in Machine Speech Chain Using Gradient Episodic Memory
원문 초록
Continual learning for automatic speech recognition (ASR) systems poses a challenge, especially with the need to avoid catastrophic forgetting while maintaining performance on previously learned tasks. This paper introduces a novel approach leveraging the machine speech chain framework to enable continual learning in ASR using gradient episodic memory (GEM). By incorporating a text-to-speech (TTS) component within the machine speech chain, we support the replay mechanism essential for GEM, allowing the ASR model to learn new tasks sequentially without significant performance degradation on earlier tasks. Our experiments, conducted on the LJ Speech dataset, demonstrate that our method outperforms traditional fine-tuning and multitask learning approaches, achieving a substantial error rate reduction while maintaining high performance across varying noise conditions. We showed the potential of our semi-supervised machine speech chain approach for effective and efficient continual learning in speech recognition.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
From Tens of Hours to Tens of Thousands: Scaling Back-Translation for Speech Recognition
NonverbalTTS: A Public English Corpus of Text-Aligned Nonverbal Vocalizations with Emotion Annotations for Text-to-Speech
LM-SPT: LM-Aligned Semantic Distillation for Speech Tokenization
Transcript-Prompted Whisper with Dictionary-Enhanced Decoding for Japanese Speech Annotation
KIT's Low-resource Speech Translation Systems for IWSLT2025: System Enhancement with Synthetic Data and Model Regularization
Mlphon: A Multifunctional Grapheme-Phoneme Conversion Tool Using Finite State Transducers
토론
이 논문과 연결된 포럼 글이 아직 없습니다.