Large Language Model Should Understand Pinyin for Chinese ASR Error Correction
원문 초록
Large language models can enhance automatic speech recognition systems through generative error correction. In this paper, we propose Pinyin-enhanced GEC, which leverages Pinyi, the phonetic representation of Mandarin Chinese, as supplementary information to improve Chinese ASR error correction. Our approach only utilizes synthetic errors for training and employs the one-best hypothesis during inference. Additionally, we introduce a multitask training approach involving conversion tasks between Pinyin and text to align their feature spaces. Experiments on the Aishell-1 and the Common Voice datasets demonstrate that our approach consistently outperforms GEC with text-only input. More importantly, we provide intuitive explanations for the effectiveness of PY-GEC and multitask training from two aspects: 1) increased attention weight on Pinyin features; and 2) aligned feature space between Pinyin and text hidden states.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Bi-directional Context-Enhanced Speech Large Language Models for Multilingual Conversational ASR
LM-SPT: LM-Aligned Semantic Distillation for Speech Tokenization
Thinking in Directivity: Speech Large Language Model for Multi-Talker Directional Speech Recognition
Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models
NTU Speechlab LLM-Based Multilingual ASR System for Interspeech MLC-SLM Challenge 2025
Mlphon: A Multifunctional Grapheme-Phoneme Conversion Tool Using Finite State Transducers
토론
이 논문과 연결된 포럼 글이 아직 없습니다.