Visual speech recognition: aligning terminologies for better understanding
원문 초록
We are at an exciting time for machine lipreading. Traditional research stemmed from the adaptation of audio recognition systems. But now, the computer vision community is also participating. This joining of two previously disparate areas with different perspectives on computer lipreading is creating opportunities for collaborations, but in doing so the literature is experiencing challenges in knowledge sharing due to multiple uses of terms and phrases and the range of methods for scoring results. In particular we highlight three areas with the intention to improve communication between those researching lipreading; the effects of interchanging between speech reading and lipreading; speaker dependence across train, validation, and test splits; and the use of accuracy, correctness, errors, and varying units (phonemes, visemes, words, and sentences) to measure system performance. We make recommendations as to how we can be more consistent.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Audio-Visual Representation Learning via Knowledge Distillation from Speech Foundation Models
Watch Your Mouth: Silent Speech Recognition with Depth Sensing
Visual Speech Recognition in a Driver Assistance System
Part-based Lipreading for Audio-Visual Speech Recognition
Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language
CoGenAV: Versatile Audio-Visual Representation Learning via Contrastive-Generative Synchronization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.