Papers with Code 아카이브

Visual Speech Recognition

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법 전체 데이터셋

하위 태스크: 1
평가표: 2
보존된 평가 기록: 5

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/ms-dot-k/AVSR

공식 코드

Visual Context-driven Audio Feature Enhancement for Robust End-to-End Audio-Visual Speech Recognition

https://github.com/ms-dot-k/Lip-to-Speech-Synthesis-in-the-Wild

공식 코드

Lip-to-Speech Synthesis in the Wild with Multi-task Learning

https://github.com/ms-dot-k/Visual-Context-Attentional-GAN

공식 코드

Lip to Speech Synthesis with Visual Context Attentional GAN

https://github.com/nphamdinh/transfer-learning-vsr-mouthing-sign-language

공식 코드

Transfer Learning from Visual Speech Recognition to Mouthing Recognition in German Sign Language

https://github.com/roudimit/whisper-flamingo

공식 코드

Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation

https://github.com/sailordiary/deep-face-vsr

공식 코드

Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech Recognition

https://github.com/sally-sh/vsp-llm

공식 코드

Where Visual Speech Meets Language: VSP-LLM Framework for Efficient and Context-Aware Visual Speech Processing

https://github.com/springhuo/mavd

공식 코드

MAVD: The First Open Large-Scale Mandarin Audio-Visual Dataset with Depth Information

https://github.com/sungnyun/avsr-temporal-dynamics

공식 코드

Learning Video Temporal Dynamics with Cross-Modal Attention for Robust Audio-Visual Speech Recognition

https://github.com/sungnyun/cav2vec

공식 코드

Multi-Task Corrupted Prediction for Learning Robust Audio-Visual Speech Representation

https://github.com/tstafylakis/Lipreading-ResNet

공식 코드

Combining Residual Networks with LSTMs for Lipreading

https://github.com/umbertocappellazzo/llama-avsr

공식 코드

Large Language Models are Strong Audio-Visual Speech Recognition Learners

https://github.com/yasserdahouml/vsr_test_set

공식 코드

Do VSR Models Generalize Beyond LRS3?

https://github.com/yuchen005/gila

공식 코드

Cross-Modal Global Interaction and Local Alignment for Audio-Visual Speech Recognition

https://github.com/yuchen005/mir-gan

공식 코드

MIR-GAN: Refining Frame-Level Modality-Invariant Representations with Adversarial Network for Audio-Visual Speech Recognition

https://github.com/yuchen005/univpm

공식 코드

Hearing Lips in Noise: Universal Viseme-Phoneme Mapping and Transfer for Robust Audio-Visual Speech Recognition

https://github.com/zqs01/multi-channel-wav2vec2

공식 코드

Multichannel AV-wav2vec2: A Framework for Learning Multichannel Multi-Modal Speech Representation

https://gitlab.com/csltstu/sunine

공식 코드

The NPU-ASLP System Description for Visual Speech Recognition in CNVSRC 2024

https://github.com/0492wzl/tensorflow_slim_densenet

Densely Connected Convolutional Networks

https://github.com/0jason000/DenseNet

Densely Connected Convolutional Networks

https://github.com/2023-MindSpore-1/ms-code-146

Densely Connected Convolutional Networks

https://github.com/2023-MindSpore-1/ms-code-16/tree/main/3D_DenseNet

Densely Connected Convolutional Networks

https://github.com/2023-MindSpore-4/Code14/tree/main/resnet3d

The NPU-ASLP-LiAuto System Description for Visual Speech Recognition in CNVSRC 2023

https://github.com/2024-MindSpore-1/Code6/tree/main/3D_DenseNet

Densely Connected Convolutional Networks

https://github.com/AirBernard/DenseNet-by-Pytorch

Densely Connected Convolutional Networks

https://github.com/Anil1331/DenseNet

Densely Connected Convolutional Networks

https://github.com/ApexPredator1/DenseNet_tensorflow

Densely Connected Convolutional Networks

https://github.com/Asthestarsfalll/DenseNet-MegEngine

Densely Connected Convolutional Networks

https://github.com/ByakuyaUncia/DenseNetUncia

Densely Connected Convolutional Networks

https://github.com/CeLaMbDa/DenseNet_keras

Densely Connected Convolutional Networks

https://github.com/Ciprian95/Licenta

Densely Connected Convolutional Networks

https://github.com/Cjl-MedSeg/DenseNet

Densely Connected Convolutional Networks

https://github.com/Contamination-Classification/DenseNet

Densely Connected Convolutional Networks

https://github.com/DaikiTanak/manifold_mixup

Densely Connected Convolutional Networks

https://github.com/Deci-AI/super-gradients

Densely Connected Convolutional Networks

https://github.com/DeepTrial/Retina-VesselNet

Densely Connected Convolutional Networks

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.