Advances and Challenges in Deep Lip Reading
원문 초록
Driven by deep learning techniques and large-scale datasets, recent years have witnessed a paradigm shift in automatic lip reading. While the main thrust of Visual Speech Recognition (VSR) was improving accuracy of Audio Speech Recognition systems, other potential applications, such as biometric identification, and the promised gains of VSR systems, have motivated extensive efforts on developing the lip reading technology. This paper provides a comprehensive survey of the state-of-the-art deep learning based VSR research with a focus on data challenges, task-specific complications, and the corresponding solutions. Advancements in these directions will expedite the transformation of silent speech interface from theory to practice. We also discuss the main modules of a VSR pipeline and the influential datasets. Finally, we introduce some typical VSR application concerns and impediments to real-world scenarios as well as future research directions.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides
Visual Speech Recognition in a Driver Assistance System
Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language
CoGenAV: Versatile Audio-Visual Representation Learning via Contrastive-Generative Synchronization
토론
이 논문과 연결된 포럼 글이 아직 없습니다.