Papers with Code 아카이브
Lip Reading
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 3
- 보존된 평가 기록
- 3
Lip Reading is a task to infer the speech content in a video by using only the visual information, especially the lip movements. It has many crucial applications in practice, such as assisting audio-based speech recognition, biometric authentication and aiding hearing-impaired people.
Source: Mutual Information Maximization for Effective Lip Reading
코드
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
https://github.com/PrashanthaTP/wav2mov
End-to-End Speech-Driven Facial Animation with Temporal GANs
https://github.com/Yondijr/FlowerPower
https://github.com/amitai1992/AutomatedLipReading
https://github.com/catalina17/XFlow
XFlow: Cross-modal Deep Neural Networks for Audiovisual Classification
https://github.com/gaalszandi/visual_speech_recognition
https://github.com/guxm2021/MM_ALT
Learning Audio-Visual Speech Representation by Masked Multimodal Cluster Prediction
https://github.com/jingyunx/Deformation-Flow-Based-Two-stream-Network
https://github.com/lilianemomeni/KWS-Net
https://github.com/lordmartian/deep_avsr
https://github.com/manideep2510/Lipreading-Keras
https://github.com/michaeltrs/Lipreading_ResNet_LSTM
https://github.com/mpc001/Visual_Speech_Recognition_for_Multiple_Languages
https://github.com/mpc001/auto_avsr
https://github.com/ms-dot-k/Multi-head-Visual-Audio-Memory
Distinguishing Homophenes Using Multi-Head Visual-Audio Memory for Lip Reading
https://github.com/ms-dot-k/Visual-Audio-Memory
Multi-modality Associative Bridging through Memory: Speech Sound Recollected from Face Video
https://github.com/rongjiehuang/transpeech
https://github.com/smeetrs/deep_avsr
https://github.com/yerfor/geneface
GeneFace: Generalized and High-Fidelity Audio-Driven 3D Talking Face Synthesis
https://github.com/zju-vipa/KamalEngine
Hearing Lips: Improving Lip Reading by Distilling Speech Recognizers
https://github.com/zziz/pwc
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.