Papers with Code 아카이브
Audio-Visual Speech Recognition
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 4
- 보존된 평가 기록
- 24
Audio-visual speech recognition is the task of transcribing a paired audio and visual stream into text.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
TeleAntiFraud-28k: An Audio-Text Slow-Thinking Dataset for Telecom Fraud Detection
Speculative End-Turn Detector for Efficient Speech Chatbot Assistant
SupertonicTTS: Towards Highly Scalable and Efficient Text-to-Speech System
DeepAudio-V1:Towards Multi-Modal Multi-Stage End-to-End Video to Speech and Audio Generation
Dual Audio-Centric Modality Coupling for Talking Head Generation
Your voice is your voice: Supporting Self-expression through Speech Generation and LLMs in Augmented and Alternative Communication
MoonCast: High-Quality Zero-Shot Podcast Generation
MAVFlow: Preserving Paralinguistic Elements with Conditional Flow Matching for Zero-Shot AV2AV Multilingual Translation
MMS-LLaMA: Efficient LLM-based Audio-Visual Speech Recognition with Minimal Multimodal Speech Tokens
An Exhaustive Evaluation of TTS- and VC-based Data Augmentation for ASR
VocalEyes: Enhancing Environmental Perception for the Visually Impaired through Vision-Language Models and Distance-Aware Object Detection
Adaptive Audio-Visual Speech Recognition via Matryoshka-Based Multimodal LLMs
Zero-AVSR: Zero-Shot Audio-Visual Speech Recognition with LLMs by Learning Language-Agnostic Speech Representations
Scaling Rich Style-Prompted Text-to-Speech Datasets
InSerter: Speech Instruction Following with Unsupervised Interleaved Pre-training
Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens
Direct Speech to Speech Translation: A Review
UniWav: Towards Unified Pre-training for Speech Representation Learning and Generation
Telephone Surveys Meet Conversational AI: Evaluating a LLM-Based Telephone Survey System at Scale
Clip-TTS: Contrastive Text-content and Mel-spectrogram, A High-Quality Text-to-Speech Method based on Contextual Semantic Understanding
MegaTTS 3: Sparse Alignment Enhanced Latent Diffusion Transformer for Zero-Shot Speech Synthesis
Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Vision
Balancing Speech Understanding and Generation Using Continual Pre-training for Codec-based Speech LLM
NaturalL2S: End-to-End High-quality Multispeaker Lip-to-Speech Synthesis with Differential Digital Signal Processing
SyncSpeech: Low-Latency and Efficient Dual-Stream Text-to-Speech based on Temporal Masked Transformer
ASVspoof 5: Design, Collection and Validation of Resources for Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speech
TokenSynth: A Token-based Neural Synthesizer for Instrument Cloning and Text-to-Instrument
Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglement
LoRP-TTS: Low-Rank Personalized Text-To-Speech
MoHAVE: Mixture of Hierarchical Audio-Visual Experts for Robust Speech Recognition
Synthetic Audio Helps for Cognitive State Tasks
Audio-Visual Representation Learning via Knowledge Distillation from Speech Foundation Models
Speech to Speech Translation with Translatotron: A State of the Art Review
IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
Gender Bias in Instruction-Guided Speech Synthesis Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.