Papers with Code 아카이브
Lip Reading
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 3
- 보존된 평가 기록
- 3
Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.
Source: Mutual Information Maximization for Effective Lip Reading
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading
Deep Learning-based Spatio Temporal Facial Feature Visual Speech Recognition
PixelRNN: In-pixel Recurrent Neural Networks for End-to-end-optimized Perception with Neural Sensors
Word-level Persian Lipreading Dataset
SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervision
Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert
A large-scale multimodal dataset of human speech recognition
MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis
A Multi-Purpose Audio-Visual Corpus for Multi-Modal Persian Speech Recognition: the Arman-AV Dataset
OLKAVS: An Open Large-Scale Korean Audio-Visual Speech Dataset
Speech Driven Video Editing via an Audio-Conditioned Diffusion Model
Audio-Visual Efficient Conformer for Robust Speech Recognition
Audio-visual video face hallucination with frequency supervision and cross modality support by speech based lip reading loss
Lip Sync Matters: A Novel Multimodal Forgery Detector
Streaming Audio-Visual Speech Recognition with Alignment Regularization
Audio-Visual Speech Enhancement and Separation by Utilizing Multi-Modal Self-Supervised Embeddings
A Novel Frame Structure for Cloud-Based Audio-Visual Speech Enhancement in Multimodal Hearing-aids
Clean Text and Full-Body Transformer: Microsoft's Submission to the WMT22 Shared Task on Sign Language Translation
VCSE: Time-Domain Visual-Contextual Speaker Extraction Network
Relaxed Attention for Transformer Models
Training Strategies for Improved Lip-reading
Visual Speech Recognition in a Driver Assistance System
Towards MOOCs for Lipreading: Using Synthetic Talking Heads to Train Humans in Lipreading at Scale
Speaker-adaptive Lip Reading with User-dependent Padding
Lip-Listening: Mixing Senses to Understand Lips using Cross Modality Knowledge Distillation for Word-Based Models
Learning Speaker-specific Lip-to-Speech Generation
Expression-preserving face frontalization improves visually assisted speech processing
Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video
Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading
A Multimodal German Dataset for Automatic Lip Reading Systems and Transfer Learning
Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction
LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading
Audio-Visual Synchronisation in the wild
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.