Papers with Code 아카이브
Lip Reading
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 3
- 보존된 평가 기록
- 3
Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.
Source: Mutual Information Maximization for Effective Lip Reading
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
LipSound2: Self-Supervised Pre-Training for Lip-to-Speech Reconstruction and Lip Reading
Audio-Visual Synchronisation in the wild
Visual Keyword Spotting with Attention
Advances and Challenges in Deep Lip Reading
Sub-word Level Lip Reading With Visual Attention
Perception Point: Identifying Critical Learning Periods in Speech for Bilingual Networks
Audio-Visual Speech Recognition is Worth 32$\times$32$\times$8 Voxels
LRWR: Large-Scale Benchmark for Lip Reading in Russian language
SimulLR: Simultaneous Lip Reading Transducer with Attention-Guided Adaptive Memory
Adaptive Semantic-Spatio-Temporal Graph Convolutional Network for Lip Reading
Spatio-Temporal Attention Mechanism and Knowledge Distillation for Lip Reading
Facetron: A Multi-speaker Face-to-Speech Model based on Cross-modal Latent Representations
LiRA: Learning Visual Speech Representations from Audio through Self-supervision
Selective Listening by Synchronizing Speech with Lips
Multi-Perspective LSTM for Joint Visual Representation Learning
End-to-End Video-To-Speech Synthesis using Generative Adversarial Networks
Fusing information streams in end-to-end audio-visual speech recognition
Lip reading using external viseme decoding
Contrastive Learning of Global-Local Video Representations
End-to-end Audio-visual Speech Recognition with Conformers
Lip-reading with Hierarchical Pyramidal Convolution and Self-Attention
AuthNet: A Deep Learning based Authentication Mechanism using Temporal Facial Feature Movements
Disentangling Homophemes in Lip Reading using Perplexity Analysis
Learn an Effective Lip Reading Model without Pains
Lip-reading with Densely Connected Temporal Convolutional Networks
A Study on Lip Localization Techniques used for Lip reading from a Video
Seeing wake words: Audio-visual Keyword Spotting
Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis
Synchronous Bidirectional Learning for Multilingual Lip Reading
Seeing voices and hearing voices: learning discriminative embeddings using cross-modal self-supervision
Mutual Information Maximization for Effective Lip Reading
Deformation Flow Based Two-Stream Network for Lip Reading
Pseudo-Convolutional Policy Gradient for Sequence-to-Sequence Lip-Reading
Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech Recognition
Re-synchronization using the Hand Preceding Model for Multi-modal Fusion in Automatic Continuous Cued Speech Recognition
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.