Papers with Code 아카이브
Lip Reading
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 3
- 보존된 평가 기록
- 3
Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.
Source: Mutual Information Maximization for Effective Lip Reading
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer
Transforming faces into video stories -- VideoFace2.0
Development and evaluation of a deep learning algorithm for German word recognition from lip movements
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides
VALLR: Visual ASR Language Model for Lip Reading
Lend a Hand: Semi Training-Free Cued Speech Recognition via MLLM-Driven Hand Modeling for Barrier-free Communication
Integrating Persian Lip Reading in Surena-V Humanoid Robot for Human-Robot Interaction
GLaM-Sign: Greek Language Multimodal Lip Reading with Integrated Sign Language Accessibility
LipGen: Viseme-Guided Lip Video Generation for Enhancing Visual Speech Recognition
Spatio-temporal Transformers for Action Unit Classification with Event Cameras
Quantitative Analysis of Audio-Visual Tasks: An Information-Theoretic Perspective
Neuromorphic Facial Analysis with Cross-Modal Supervision
RAL:Redundancy-Aware Lipreading Model Based on Differential Learning with Symmetric Views
Personalized Lip Reading: Adapting to Your Unique Lip Movements with Vision and Language
Enhancing Speech-Driven 3D Facial Animation with Audio-Visual Guidance from Lip Reading Expert
Robust Multi-Modal Speech In-Painting: A Sequence-to-Sequence Approach
Bridge to Non-Barrier Communication: Gloss-Prompted Fine-grained Cued Speech Gesture Generation with Diffusion Model
MTGA: Multi-View Temporal Granularity Aligned Aggregation for Event-Based Lip-Reading
Enhancing Lip Reading with Multi-Scale Video and Multi-Encoder
Landmark-Guided Cross-Speaker Lip Reading with Mutual Information Regularization
Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing
Cross-Attention Fusion of Visual and Geometric Features for Large Vocabulary Arabic Lipreading
Computation and Parameter Efficient Multi-Modal Fusion Transformer for Cued Speech Recognition
Neural Text to Articulate Talk: Deep Text to Audiovisual Speech Synthesis achieving both Auditory and Photo-realism
Do VSR Models Generalize Beyond LRS3?
Exploring Lip Segmentation Techniques in Computer Vision: A Comparative Analysis
DualTalker: A Cross-Modal Dual Learning Approach for Speech-Driven 3D Facial Animation
Learning Separable Hidden Unit Contributions for Speaker-Adaptive Lip-Reading
End-to-End Lip Reading in Romanian with Cross-Lingual Domain Adaptation and Lateral Inhibition
Lip Reading for Low-resource Languages by Learning and Combining General Speech Knowledge and Language-specific Knowledge
Lip2Vec: Efficient and Robust Visual Speech Recognition via Latent-to-Latent Visual to Audio Representation Mapping
Leveraging Visemes for Better Visual Speech Representation and Lip Reading
SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces
Emotional Speech-Driven Animation with Content-Emotion Disentanglement
OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality Alignment
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.