Benchmarking Japanese Speech Recognition on ASR-LLM Setups with Multi-Pass Augmented Generative Error Correction
원문 초록
With the strong representational power of large language models (LLMs), generative error correction (GER) for automatic speech recognition (ASR) aims to provide semantic and phonetic refinements to address ASR errors. This work explores how LLM-based GER can enhance and expand the capabilities of Japanese language processing, presenting the first GER benchmark for Japanese ASR with 0.9-2.6k text utterances. We also introduce a new multi-pass augmented generative error correction (MPA GER) by integrating multiple system hypotheses on the input side with corrections from multiple LLMs on the output side and then merging them. To the best of our knowledge, this is the first investigation of the use of LLMs for Japanese GER, which involves second-pass language modeling on the output transcriptions generated by the ASR system (e.g., N-best hypotheses). Our experiments demonstrated performance improvement in the proposed methods of ASR quality and generalization both in SPREDS-U1-ja and CSJ data.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
LM-SPT: LM-Aligned Semantic Distillation for Speech Tokenization
Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models
Bi-directional Context-Enhanced Speech Large Language Models for Multilingual Conversational ASR
Mlphon: A Multifunctional Grapheme-Phoneme Conversion Tool Using Finite State Transducers
mTSBench: Benchmarking Multivariate Time Series Anomaly Detection and Model Selection at Scale
BMFM-RNA: An Open Framework for Building and Evaluating Transcriptomic Foundation Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.