Resolution limits on visual speech recognition
원문 초록
Visual-only speech recognition is dependent upon a number of factors that can be difficult to control, such as: lighting; identity; motion; emotion and expression. But some factors, such as video resolution are controllable, so it is surprising that there is not yet a systematic study of the effect of resolution on lip-reading. Here we use a new data set, the Rosetta Raven data, to train and test recognizers so we can measure the affect of video resolution on recognition accuracy. We conclude that, contrary to common practice, resolution need not be that great for automatic lip-reading. However it is highly unlikely that automatic lip-reading can work reliably when the distance between the bottom of the lower lip and the top of the upper lip is less than four pixels at rest.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides
Visual Speech Recognition in a Driver Assistance System
Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language
CoGenAV: Versatile Audio-Visual Representation Learning via Contrastive-Generative Synchronization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.