arXiv:1710.01093
Which phoneme-to-viseme maps best improve visual-only computer lip-reading?
원문 초록
A critical assumption of all current visual speech recognition systems is that there are visual speech units called visemes which can be mapped to units of acoustic speech, the phonemes. Despite there being a number of published maps it is infrequent to see the effectiveness of these tested, particularly on visual-only lip-reading (many works use audio-visual speech). Here we examine 120 mappings and consider if any are stable across talkers. We show a method for devising maps based on phoneme confusions from an automated lip-reading system, and we present new mappings that show improvements for individual talkers.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides
Visual Speech Recognition in a Driver Assistance System
Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language
CoGenAV: Versatile Audio-Visual Representation Learning via Contrastive-Generative Synchronization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.