Papers with Code 아카이브
Lip Reading
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 3
- 보존된 평가 기록
- 3
Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.
Source: Mutual Information Maximization for Effective Lip Reading
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/Fengdalu/learn-an-effective-lip-reading-model-without-pains
공식 코드https://github.com/Mohit-Mithra/Face-Recognition-Systems-with-lip-movement-pattern
공식 코드AuthNet: A Deep Learning based Authentication Mechanism using Temporal Facial Feature Movements
https://github.com/Rudrabha/Lip2Wav
공식 코드Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis
https://github.com/brkljac/videoface2.0
공식 코드https://github.com/burchim/avec
공식 코드Audio-Visual Efficient Conformer for Robust Speech Recognition
https://github.com/dennishgj/stf_acsr
공식 코드https://github.com/exgc/avmust-ted
공식 코드https://github.com/exgc/opensr
공식 코드OpenSR: Open-Modality Speech Recognition via Maintaining Multi-Modality Alignment
https://github.com/facebookresearch/av_hubert
공식 코드Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction
https://github.com/g-milis/NEUTART
공식 코드https://github.com/hassanhub/LipReading
공식 코드Lip2AudSpec: Speech reconstruction from silent lip movements video
https://github.com/iip-sogang/olkavs-avspeech
공식 코드OLKAVS: An Open Large-Scale Korean Audio-Visual Speech Dataset
https://github.com/jeonghun0716/personalized-lip-reading
공식 코드Personalized Lip Reading: Adapting to Your Unique Lip Movements with Vision and Language
https://github.com/jinchiniao/LSHUC
공식 코드Learning Separable Hidden Unit Contributions for Speaker-Adaptive Lip-Reading
https://github.com/lufei321/resync-cs
공식 코드https://github.com/lumia-group/leveraging-self-supervised-learning-for-avsr
공식 코드Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition
https://github.com/luomingshuang/SBL_For_Multilingual_Lip_Reading
공식 코드Synchronous Bidirectional Learning for Multilingual Lip Reading
https://github.com/mpc001/Lipreading_using_Temporal_Convolutional_Networks
공식 코드Lip-reading with Densely Connected Temporal Convolutional Networks
https://github.com/ms-dot-k/User-dependent-Padding
공식 코드https://github.com/prajwalkr/transpotter
공식 코드https://github.com/psyai-net/SelfTalk_release
공식 코드SelfTalk: A Self-Supervised Commutative Training Diagram to Comprehend 3D Talking Faces
https://github.com/sailordiary/deep-face-vsr
공식 코드Can We Read Speech Beyond the Lips? Rethinking RoI Selection for Deep Visual Speech Recognition
https://github.com/sally-sh/vsp-llm
공식 코드https://github.com/sxjdwang/talklip
공식 코드Seeing What You Said: Talking Face Generation Guided by a Lip Reading Expert
https://github.com/tstafylakis/Lipreading-ResNet
공식 코드https://github.com/whu125/mtga
공식 코드MTGA: Multi-View Temporal Granularity Aligned Aggregation for Event-Based Lip-Reading
https://github.com/xing96/MIM-lipreading
공식 코드https://github.com/yasserdahouml/vsr_test_set
공식 코드https://github.com/yochaiye/LipVoicer
공식 코드LipVoicer: Generating Speech from Silent Videos Guided by Lip Reading
https://github.com/yunyikristy/global_local
공식 코드https://github.com/zexupan/reentry
공식 코드https://github.com/Fengdalu/Lipreading-DenseNet3D
LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild
https://github.com/Hangz-nju-cuhk/Talking-Face-Generation-DAVS
Talking Face Generation by Adversarially Disentangled Audio-Visual Representation
https://github.com/Mohit-Mithra/AuthNet
AuthNet: A Deep Learning based Authentication Mechanism using Temporal Facial Feature Movements
https://github.com/NirHeaven/D3D
LRW-1000: A Naturally-Distributed Large-Scale Benchmark for Lip Reading in the Wild
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.