Papers with Code 아카이브
Speech Synthesis
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 15
- 평가표
- 5
- 보존된 평가 기록
- 31
Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.
Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.
<span style="color:grey; opacity: 0.6">( Image credit: WaveNet: A generative model for raw audio )</span>
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Speech Quality Assessment Model Based on Mixture of Experts: System-Level Performance Enhancement and Utterance-Level Challenge Analysis
A Hybrid Machine Learning Framework for Optimizing Crop Selection via Agronomic and Economic Forecasting
DeepGesture: A conversational gesture synthesis system based on emotions and semantics
OpusLM: A Family of Open Unified Speech Language Models
RapFlow-TTS: Rapid and High-Fidelity Text-to-Speech with Improved Consistency Flow Matching
InstructTTSEval: Benchmarking Complex Natural-Language Instruction Following in Text-to-Speech Systems
An accurate and revised version of optical character recognition-based speech synthesis using LabVIEW
Pushing the Performance of Synthetic Speech Detection with Kolmogorov-Arnold Networks and Self-Supervised Learning Models
ZipVoice: Fast and High-Quality Zero-Shot Text-to-Speech with Flow Matching
From Flat to Feeling: A Feasibility and Impact Study on Dynamic Facial Emotions in AI-Generated Avatars
OmniDRCA: Parallel Speech-Text Foundation Model via Dual-Resolution Speech Representations and Contrastive Alignment
UmbraTTS: Adapting Text-to-Speech to Environmental Contexts with Flow Matching
S2ST-Omni: An Efficient and Scalable Multilingual Speech-to-Speech Translation Framework via Seamless Speech-Text Alignment and Streaming Speech Generation
Step-Audio-AQAA: a Fully End-to-End Expressive Large Audio Language Model
Seeing Voices: Generating A-Roll Video from Audio with Mirage
A Novel Data Augmentation Approach for Automatic Speaking Assessment on Opinion Expressions
HiFiTTS-2: A Large-Scale High Bandwidth Speech Dataset
Prompt-Unseen-Emotion: Zero-shot Expressive Speech Synthesis with Prompt-LLM Contextual Knowledge for Mixed Emotions
CapSpeech: Enabling Downstream Applications in Style-Captioned Text-to-Speech
SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Prediction
Counterfactual Activation Editing for Post-hoc Prosody and Mispronunciation Correction in TTS Models
Chain-of-Thought Training for Open E2E Spoken Dialogue Systems
BinauralFlow: A Causal and Streamable Approach for High-Quality Binaural Speech Synthesis with Flow Matching Models
GSA-TTS : Toward Zero-Shot Speech Synthesis based on Gradual Style Adaptor
Zero-Shot Streaming Text to Speech Synthesis with Transducer and Auto-Regressive Modeling
DiEmo-TTS: Disentangled Emotion Representations via Self-Supervised Distillation for Cross-Speaker Emotion Transfer in Text-to-Speech
ArVoice: A Multi-Speaker Dataset for Arabic Speech Synthesis
Revival with Voice: Multi-modal Controllable Text-to-Speech Synthesis
RASMALAI: Resources for Adaptive Speech Modeling in Indian Languages with Accents and Intonations
CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-training
Accelerating Autoregressive Speech Synthesis Inference With Speech Speculative Decoding
Audio Jailbreak: An Open Comprehensive Benchmark for Jailbreaking Large Audio-Language Models
MIKU-PAL: An Automated and Standardized Multi-Modal Method for Speech Paralinguistic and Affect Labeling
Articulatory Feature Prediction from Surface EMG during Speech Production
FMSD-TTS: Few-shot Multi-Speaker Multi-Dialect Text-to-Speech Synthesis for Ü-Tsang, Amdo and Kham Speech Dataset Generation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.