Papers with Code 아카이브
Audio-Visual Speech Recognition
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 4
- 보존된 평가 기록
- 24
Audio-visual speech recognition is the task of transcribing a paired audio and visual stream into text.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
The Multimodal Information Based Speech Processing (MISP) 2025 Challenge: Audio-Visual Diarization and Recognition
SeamlessEdit: Background Noise Aware Zero-Shot Speech Editing with in-Context Enhancement
AudioJailbreak: Jailbreak Attacks against End-to-End Large Audio-Language Models
Scaling and Enhancing LLM-based AVSR: A Sparse Mixture of Projectors Approach
FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for Ü-Tsang, Amdo and Kham Speech Dataset Generation
Impact of Frame Rates on Speech Tokenizer: A Case Study on Mandarin and English
OZSpeech: One-step Zero-shot Speech Synthesis with Learned-Prior-Conditioned Flow Matching
Shallow Flow Matching for Coarse-to-Fine Text-to-Speech Synthesis
BanglaFake: Constructing and Evaluating a Specialized Bengali Deepfake Audio Dataset
Audio Turing Test: Benchmarking the Human-likeness of Large Language Model-based Text-to-Speech Systems in Chinese
UDDETTS: Unifying Discrete and Dimensional Emotions for Controllable Emotional Text-to-Speech
Lightweight End-to-end Text-to-speech Synthesis for low resource on-device applications
MiniMax-Speech: Intrinsic Zero-Shot Text-to-Speech with a Learnable Speaker Encoder
Bridging the Gap: An Intermediate Language for Enhanced and Cost-Effective Grapheme-to-Phoneme Conversion with Homographs with Multiple Pronunciations Disambiguation
Teochew-Wild: The First In-the-wild Teochew Dataset with Orthographic Annotations
FlexSpeech: Towards Stable, Controllable and Expressive Text-to-Speech
SwinLip: An Efficient Visual Speech Encoder for Lip Reading Using Swin Transformer
CoGenAV: Versatile Audio-Visual Representation Learning via Contrastive-Generative Synchronization
VITA-Audio: Fast Interleaved Cross-Modal Token Generation for Efficient Large Speech-Language Model
Voila: Voice-Language Foundation Models for Real-Time Autonomous Interaction and Voice Role-Play
Generating Narrated Lecture Videos from Slides with Synchronized Highlights
Sadeed: Advancing Arabic Diacritization Through Small Language Model
Towards Flow-Matching-based TTS without Classifier-Free Guidance
ClonEval: An Open Voice Cloning Benchmark
A Multi-Agent Framework for Automated Qinqiang Opera Script Generation Using Large Language Models
Chinese-LiPS: A Chinese audio-visual speech recognition dataset with Lip-reading and Presentation Slides
EmoVoice: LLM-based Emotional Text-To-Speech Model with Freestyle Text Prompting
GOAT-TTS: Expressive and Realistic Speech Generation via A Dual-Branch LLM
AutoStyle-TTS: Retrieval-Augmented Generation based Automatic Style Matching Text-to-Speech Synthesis
Pseudo-Autoregressive Neural Codec Language Models for Efficient Zero-Shot Text-to-Speech Synthesis
Generalized Multilingual Text-to-Speech Generation with Language-Aware Style Adaptation
SlimSpeech: Lightweight and Efficient Text-to-Speech with Slim Rectified Flow
Empowering Global Voices: A Data-Efficient, Phoneme-Tone Adaptive Approach to High-Fidelity Speech Synthesis
Visual-Aware Speech Recognition for Noisy Scenarios
SpeakEasy: Enhancing Text-to-Speech Interactions for Expressive Content Creation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.