Papers with Code 아카이브
Audio-Visual Speech Recognition
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 4
- 보존된 평가 기록
- 24
Audio-visual speech recognition is the task of transcribing a paired audio and visual stream into text.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
NonverbalTTS: A Public English Corpus of Text-Aligned Nonverbal Vocalizations with Emotion Annotations for Text-to-Speech
P.808 Multilingual Speech Enhancement Testing: Approach and Results of URGENT 2025 Challenge
An Empirical Evaluation of AI-Powered Non-Player Characters' Perceived Realism and Performance in Virtual Reality Environments
ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching
MIDI-VALLE: Improving Expressive Piano Performance Synthesis Through Neural Codec Language Modelling
Exploiting Leaderboards for Large-Scale Distribution of Malicious Models
Differentiable Reward Optimization for LLM based TTS system
Speech Quality Assessment Model Based on Mixture of Experts: System-Level Performance Enhancement and Utterance-Level Challenge Analysis
PresentAgent: Multimodal Agent for Presentation Video Generation
An Exploration of ECAPA-TDNN and x-vector Speaker Representations in Zero-shot Multi-speaker TTS
TTSDS2: Resources and Benchmark for Evaluating Human-Quality Text to Speech Systems
LM-SPT: LM-Aligned Semantic Distillation for Speech Tokenization
RapFlow-TTS: Rapid and High-Fidelity Text-to-Speech with Improved Consistency Flow Matching
Optimizing Multilingual Text-To-Speech with Accents & Emotions
InstructTTSEval: Benchmarking Complex Natural-Language Instruction Following in Text-to-Speech Systems
Streaming Non-Autoregressive Model for Accent Conversion and Pronunciation Improvement
PredGen: Accelerated Inference of Large Language Models through Input-Time Speculation for Real-Time Speech Interaction
ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching
EmoNews: A Spoken Dialogue System for Expressive News Conversations
Phonikud: Hebrew Grapheme-to-Phoneme Conversion for Real-Time Text-to-Speech
StreamMel: Real-Time Zero-shot Text-to-Speech via Interleaved Continuous Autoregressive Modeling
Scheduled Interleaved Speech-Text Training for Speech-to-Speech Translation with LLMs
Ming-Omni: A Unified Multimodal Model for Perception and Generation
UmbraTTS: Adapting Text-to-Speech to Environmental Contexts with Flow Matching
S2ST-Omni: An Efficient and Scalable Multilingual Speech-to-Speech Translation Framework via Seamless Speech-Text Alignment and Streaming Speech Generation
GUIRoboTron-Speech: Towards Automated GUI Agents Based on Speech Instructions
A Self-Refining Framework for Enhancing ASR Using TTS-Synthesized Data
Transcript-Prompted Whisper with Dictionary-Enhanced Decoding for Japanese Speech Annotation
Seeing Voices: Generating A-Roll Video from Audio with Mirage
Voice Impression Control in Zero-Shot TTS
Grapheme-Coherent Phonemic and Prosodic Annotation of Speech by Implicit and Explicit Grapheme Conditioning
ViCocktail: Automated Multi-Modal Data Collection for Vietnamese Audio-Visual Speech Recognition
Intelligibility of Text-to-Speech Systems for Mathematical Expressions
BitTTS: Highly Compact Text-to-Speech Using 1.58-bit Quantization and Weight Indexing
A Novel Data Augmentation Approach for Automatic Speaking Assessment on Opinion Expressions
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.