| Auto-AVSR |
- Word Error Rate (WER)
- 14.6
|
Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels
2023-03-25 |
코드 1 · 코드 2 |
| USR |
- Word Error Rate (WER)
- 15.4
|
Unified Speech Recognition: A Single Model for Auditory, Visual, and Audiovisual Inputs
2024-11-04 |
코드 1 |
| SyncVSR |
- Word Error Rate (WER)
- 28.9
|
SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization
2024-06-18 |
코드 1 |
| RAVEn Large |
- Word Error Rate (WER)
- 18.6
|
Jointly Learning Visual and Auditory Speech Representations from Raw Data
2022-12-12 |
코드 1 |
| VTP (more data) |
- Word Error Rate (WER)
- 22.6
|
Sub-word Level Lip Reading With Visual Attention
2021-10-14 |
연결 없음 |
| ES³ Large + extLM |
- Word Error Rate (WER)
- 24.6
|
ES3: Evolving Self-Supervised Learning of Robust Audio-Visual Speech Representations
2024-01-01 |
연결 없음 |
| CTC/Attention (LRW+LRS2/3+AVSpeech) |
- Word Error Rate (WER)
- 25.5
|
Visual Speech Recognition for Multiple Languages in the Wild
2022-02-26 |
코드 1 · 코드 2 |
| ES³ Large |
- Word Error Rate (WER)
- 26.7
|
ES3: Evolving Self-Supervised Learning of Robust Audio-Visual Speech Representations
2024-01-01 |
연결 없음 |
| ES³ Base + extLM |
- Word Error Rate (WER)
- 28.7
|
ES3: Evolving Self-Supervised Learning of Robust Audio-Visual Speech Representations
2024-01-01 |
연결 없음 |
| VTP |
- Word Error Rate (WER)
- 28.9
|
Sub-word Level Lip Reading With Visual Attention
2021-10-14 |
연결 없음 |
| ES³ Base* + extLM |
- Word Error Rate (WER)
- 29.3
|
ES3: Evolving Self-Supervised Learning of Robust Audio-Visual Speech Representations
2024-01-01 |
연결 없음 |
| ES³ Base |
- Word Error Rate (WER)
- 30.7
|
ES3: Evolving Self-Supervised Learning of Robust Audio-Visual Speech Representations
2024-01-01 |
연결 없음 |
| ES³ Base* |
- Word Error Rate (WER)
- 31.4
|
ES3: Evolving Self-Supervised Learning of Robust Audio-Visual Speech Representations
2024-01-01 |
연결 없음 |
| CTC/Attention |
- Word Error Rate (WER)
- 32.9
|
Visual Speech Recognition for Multiple Languages in the Wild
2022-02-26 |
코드 1 · 코드 2 |
| Hybrid CTC / Attention |
- Word Error Rate (WER)
- 39.1
|
End-to-end Audio-visual Speech Recognition with Conformers
2021-02-12 |
코드 1 · 코드 2 · 코드 3 |
| MoCo + wav2vec (w/o extLM) |
- Word Error Rate (WER)
- 43.2
|
Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition
2022-02-24 |
코드 1 |
| Multi-head Visual-Audio Memory |
- Word Error Rate (WER)
- 44.5
|
Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading
2022-04-04 |
코드 1 |
| TM-seq2seq + extLM |
- Word Error Rate (WER)
- 48.3
|
Deep Audio-Visual Speech Recognition
2018-09-06 |
코드 1 · 코드 2 · 코드 3 · 코드 4 |
| LF-MMI TDNN |
- Word Error Rate (WER)
- 48.86
|
Audio-visual Recognition of Overlapped speech for the LRS2 dataset
2020-01-06 |
연결 없음 |
| Hybrid CTC / Attention |
- Word Error Rate (WER)
- 50
|
Audio-Visual Speech Recognition With A Hybrid CTC/Attention Architecture
2018-09-28 |
연결 없음 |
| Conv-seq2seq |
- Word Error Rate (WER)
- 51.7
|
Spatio-Temporal Fusion Based Convolutional Sequence Learning for Lip Reading
2019-10-01 |
연결 없음 |
| CTC + KD ASR |
- Word Error Rate (WER)
- 53.2
|
ASR is all you need: cross-modal distillation for lip reading
2019-11-28 |
연결 없음 |
| TM-CTC + extLM |
- Word Error Rate (WER)
- 54.7
|
Deep Audio-Visual Speech Recognition
2018-09-06 |
코드 1 · 코드 2 · 코드 3 · 코드 4 |
| LIBS |
- Word Error Rate (WER)
- 65.29
|
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers
2019-11-26 |
코드 1 |