Papers with Code 아카이브
Visual Speech Recognition
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 2
- 보존된 평가 기록
- 5
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation
CNVSRC 2023: The First Chinese Continuous Visual Speech Recognition Challenge
Watch Your Mouth: Silent Speech Recognition with Depth Sensing
Learn2Talk: 3D Talking Face Learns from 2D Talking Face
XLAVS-R: Cross-Lingual Audio-Visual Speech Representation Learning for Noise-Robust Speech Perception
Multilingual Audio-Visual Speech Recognition with Hybrid CTC/RNN-T Fast Conformer
A Study of Dropout-Induced Modality Bias on Robustness to Missing Video Frames for Audio-Visual Speech Recognition
JEP-KD: Joint-Embedding Predictive Architecture Based Knowledge Distillation for Visual Speech Recognition
Towards Accurate Lip-to-Speech Synthesis in-the-Wild
Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing
Comparison of Conventional Hybrid and CTC/Attention Decoders for Continuous Visual Speech Recognition
It's Never Too Late: Fusing Acoustic Information into Large Language Models for Automatic Speech Recognition
SlideAVSR: A Dataset of Paper Explanation Videos for Audio-Visual Speech Recognition
Efficient Training for Multilingual Visual Speech Recognition: Pre-training with Discretized Visual Speech Representation
MLCA-AVSR: Multi-Layer Cross Attention Fusion based Audio-Visual Speech Recognition
Multichannel AV-wav2vec2: A Framework for Learning Multichannel Multi-Modal Speech Representation
The NPU-ASLP-LiAuto System Description for Visual Speech Recognition in CNVSRC 2023
LiteVSR: Efficient Visual Speech Recognition by Learning from Speech Representations of Unlabeled Data
The GUA-Speech System Description for CNVSRC Challenge 2023
Do VSR Models Generalize Beyond LRS3?
LIP-RTVE: An Audiovisual Database for Continuous Spanish in the Wild
Analysis of Visual Features for Continuous Lipreading in Spanish
Speaker-Adapted End-to-End Visual Speech Recognition for Continuous Spanish
End-to-End Lip Reading in Romanian with Cross-Lingual Domain Adaptation and Lateral Inhibition
AV-CPL: Continuous Pseudo-Labeling for Audio-Visual Speech Recognition
The Multimodal Information Based Speech Processing (MISP) 2023 Challenge: Audio-Visual Target Speaker Extraction
Visual Speech Recognition for Languages with Limited Labeled Data using Automatic Labels from Whisper
AKVSR: Audio Knowledge Empowered Visual Speech Recognition by Compressing Audio Knowledge of a Pretrained Model
Improving Audio-Visual Speech Recognition by Lip-Subword Correlation Based Visual Pre-training and Cross-Modal Fusion Encoder
Lip2Vec: Efficient and Robust Visual Speech Recognition via Latent-to-Latent Visual to Audio Representation Mapping
SparseVSR: Lightweight and Noise Robust Visual Speech Recognition
RobustL2S: Speaker-Specific Lip-to-Speech Synthesis exploiting Self-Supervised Representations
Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition
MIR-GAN: Refining Frame-Level Modality-Invariant Representations with Adversarial Network for Audio-Visual Speech Recognition
Automated Speaker Independent Visual Speech Recognition: A Comprehensive Survey
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.