Unsupervised speech intelligibility assessment with utterance level alignment distance between teacher and learner Wav2Vec-2.0 representations
원문 초록
Speech intelligibility is crucial in language learning for effective communication. Thus, to develop computer-assisted language learning systems, automatic speech intelligibility detection (SID) is necessary. Most of the works have assessed the intelligibility in a supervised manner considering manual annotations, which requires cost and time; hence scalability is limited. To overcome these, this work proposes an unsupervised approach for SID. The proposed approach considers alignment distance computed with dynamic-time warping (DTW) between teacher and learner representation sequence as a measure to separate intelligible versus non-intelligible speech. We obtain the feature sequence using current state-of-the-art self-supervised representations from Wav2Vec-2.0. We found the detection accuracies as 90.37\%, 92.57\% and 96.58\%, respectively, with three alignment distance measures -- mean absolute error, mean squared error and cosine distance (equal to one minus cosine similarity).
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ActAlign: Zero-Shot Fine-Grained Video Classification via Language-Guided Sequence Alignment
TimePoint: Accelerated Time Series Alignment via Self-Supervised Keypoint and Descriptor Learning
Semi-Supervised Image-Based Narrative Extraction: A Case Study with Historical Photographic Records
Automatic Differentiation-based Full Waveform Inversion with Flexible Workflows
Contrast Similarity-Aware Dual-Pathway Mamba for Multivariate Time Series Node Classification
Multiscale Dubuc: A New Similarity Measure for Time Series
토론
이 논문과 연결된 포럼 글이 아직 없습니다.