Speaker Tagging Correction With Non-Autoregressive Language Models
원문 초록
Speech applications dealing with conversations require not only recognizing the spoken words but also determining who spoke when. The task of assigning words to speakers is typically addressed by merging the outputs of two separate systems, namely, an automatic speech recognition (ASR) system and a speaker diarization (SD) system. In practical settings, speaker diarization systems can experience significant degradation in performance due to a variety of factors, including uniform segmentation with a high temporal resolution, inaccurate word timestamps, incorrect clustering and estimation of speaker numbers, as well as background noise. Therefore, it is important to automatically detect errors and make corrections if possible. We used a second-pass speaker tagging correction system based on a non-autoregressive language model to correct mistakes in words placed at the borders of sentences spoken by different speakers. We first show that the employed error correction approach leads to reductions in word diarization error rate (WDER) on two datasets: TAL and test set of Fisher. Additionally, we evaluated our system in the Post-ASR Speaker Tagging Correction challenge and observed significant improvements in cpWER compared to baseline methods.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Seewo's Submission to MLC-SLM: Lessons learned from Speech Reasoning Language Models
LM-SPT: LM-Aligned Semantic Distillation for Speech Tokenization
Bi-directional Context-Enhanced Speech Large Language Models for Multilingual Conversational ASR
Improving Named Entity Transcription with Contextual LLM-based Revision
Automatic Speech Recognition of African American English: Lexical and Contextual Effects
LESS: Large Language Model Enhanced Semi-Supervised Learning for Speech Foundational Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.