https://github.com/lumia-group/leveraging-self-supervised-learning-for-avsr
공식 코드Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Audio-visual speech recognition is the task of transcribing a paired audio and visual stream into text.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Leveraging Unimodal Self-Supervised Learning for Multimodal Audio-Visual Speech Recognition
Unsupervised Text-to-Speech Synthesis by Unsupervised Automatic Speech Recognition
Voila: Voice-Language Foundation Models for Real-Time Autonomous Interaction and Voice Role-Play
Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models
Speechless: Speech Instruction Training Without Speech for Low Resource Languages
LightSpeech: Lightweight and Fast Text to Speech with Neural Architecture Search
E2 TTS: Embarrassingly Easy Fully Non-Autoregressive Zero-Shot TTS
Neural Codec Language Models are Zero-Shot Text to Speech Synthesizers
Multimodal Latent Language Modeling with Next-Token Diffusion
Hierarchical Prosody Modeling for Non-Autoregressive Speech Synthesis
Generating Synthetic Speech from SpokenVocab for Speech Translation
AudioMarkBench: Benchmarking Robustness of Audio Watermarking
LPCNet: Improving Neural Speech Synthesis Through Linear Prediction
Auto-AVSR: Audio-Visual Speech Recognition with Automatic Labels
Multi-Source Spatial Knowledge Understanding for Immersive Visual Text-to-Speech
Towards Lifelong Learning of Multilingual Text-To-Speech Synthesis
PortaSpeech: Portable and High-Quality Generative Text-to-Speech
RapFlow-TTS: Rapid and High-Fidelity Text-to-Speech with Improved Consistency Flow Matching
Imaginary Voice: Face-styled Diffusion Model for Text-to-Speech
Paralinguistics-Aware Speech-Empowered Large Language Models for Natural Conversation
TransVIP: Speech to Speech Translation System with Voice and Isochrony Preservation
Systematic Inequalities in Language Technology Performance across the World's Languages
Cross-Utterance Conditioned VAE for Non-Autoregressive Text-to-Speech
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.