Papers with Code 아카이브
Visual Speech Recognition
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 2
- 보존된 평가 기록
- 5
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
MAVD: The First Open Large-Scale Mandarin Audio-Visual Dataset with Depth Information
Intelligible Lip-to-Speech Synthesis with Speech Units
Improving the Gap in Visual Speech Recognition Between Normal and Silent Speech Based on Metric Learning
Prompting the Hidden Talent of Web-Scale Speech Models for Zero-Shot Task Generalization
Cross-Modal Global Interaction and Local Alignment for Audio-Visual Speech Recognition
Zero-shot personalized lip-to-speech synthesis with face image based voice control
Multi-Temporal Lip-Audio Memory for Visual Speech Recognition
Deep Learning-based Spatio Temporal Facial Feature Visual Speech Recognition
SynthVSR: Scaling Up Visual Speech Recognition With Synthetic Supervision
Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels
Watch or Listen: Robust Audio-Visual Speech Recognition with Visual Corruption Modeling and Reliability Scoring
The NPU-ASLP System for Audio-Visual Speech Recognition in MISP 2022 Challenge
MixSpeech: Cross-Modality Self-Learning with Audio-Visual Stream Mixup for Visual Speech Translation and Recognition
On the Audio-visual Synchronization for Lip-to-Speech Synthesis
MuAViC: A Multilingual Audio-Visual Corpus for Robust Speech Recognition and Robust Speech-to-Text Translation
Deep Visual Forced Alignment: Learning to Align Transcription with Talking Face Video
Lip-to-Speech Synthesis in the Wild with Multi-task Learning
Conformers are All You Need for Visual Speech Recognition
Prompt Tuning of Deep Neural Networks for Speaker-adaptive Visual Speech Recognition
AV-data2vec: Self-supervised Learning of Audio-Visual Speech Representations with Contextualized Target Representations
A Multi-Purpose Audio-Visual Corpus for Multi-Modal Persian Speech Recognition: the Arman-AV Dataset
OLKAVS: An Open Large-Scale Korean Audio-Visual Speech Dataset
ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancement
Jointly Learning Visual and Auditory Speech Representations from Raw Data
Leveraging Modality-specific Representations for Audio-visual Speech Recognition via Reinforcement Learning
VATLM: Visual-Audio-Text Pre-Training with Unified Masked Prediction for Speech Representation Learning
Streaming Audio-Visual Speech Recognition with Alignment Regularization
Lip-to-Speech Synthesis for Arbitrary Speakers in the Wild
Visual Speech Recognition in a Driver Assistance System
Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition
FastLTS: Non-Autoregressive End-to-End Unconstrained Lip-to-Speech Synthesis
Kaggle Competition: Cantonese Audio-Visual Speech Recognition for In-car Commands
Show Me Your Face, And I'll Tell You How You Speak
Lip-Listening: Mixing Senses to Understand Lips using Cross Modality Knowledge Distillation for Word-Based Models
Is Lip Region-of-Interest Sufficient for Lipreading?
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.