Continuous Learning for Children's ASR: Overcoming Catastrophic Forgetting with Elastic Weight Consolidation and Synaptic Intelligence
원문 초록
In this work, we present the first study addressing automatic speech recognition (ASR) for children in an online learning setting. This is particularly important for both child-centric applications and the privacy protection of minors, where training models with sequentially arriving data is critical. The conventional approach of model fine-tuning often suffers from catastrophic forgetting. To tackle this issue, we explore two established techniques: elastic weight consolidation (EWC) and synaptic intelligence (SI). Using a custom protocol on the MyST corpus, tailored to the online learning setting, we achieve relative word error rate (WER) reductions of 5.21% with EWC and 4.36% with SI, compared to the fine-tuning baseline.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
NonverbalTTS: A Public English Corpus of Text-Aligned Nonverbal Vocalizations with Emotion Annotations for Text-to-Speech
WhisperKit: On-device Real-time ASR with Billion-Scale Transformers
Lightweight Target-Speaker-Based Overlap Transcription for Practical Streaming ASR
AI-Generated Song Detection via Lyrics Transcripts
End-to-End Spoken Grammatical Error Correction
LM-SPT: LM-Aligned Semantic Distillation for Speech Tokenization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.