LRWR: Large-Scale Benchmark for Lip Reading in Russian language
원문 초록
Lipreading, also known as visual speech recognition, aims to identify the speech content from videos by analyzing the visual deformations of lips and nearby areas. One of the significant obstacles for research in this field is the lack of proper datasets for a wide variety of languages: so far, these methods have been focused only on English or Chinese. In this paper, we introduce a naturally distributed large-scale benchmark for lipreading in Russian language, named LRWR, which contains 235 classes and 135 speakers. We provide a detailed description of the dataset collection pipeline and dataset statistics. We also present a comprehensive comparison of the current popular lipreading methods on LRWR and conduct a detailed analysis of their performance. The results demonstrate the differences between the benchmarked languages and provide several promising directions for lipreading models finetuning. Thanks to our findings, we also achieved new state-of-the-art results on the LRW benchmark.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Visual Speech Recognition in a Driver Assistance System
Audio-Visual Representation Learning via Knowledge Distillation from Speech Foundation Models
VisualSpeaker: Visually-Guided 3D Avatar Lip Synthesis
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides
Watch Your Mouth: Silent Speech Recognition with Depth Sensing
토론
이 논문과 연결된 포럼 글이 아직 없습니다.