Papers with Code 아카이브
Speech Synthesis
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 15
- 평가표
- 5
- 보존된 평가 기록
- 31
Speech synthesis is the task of generating speech from some other modality like text, lip movements etc.
Please note that the leaderboards here are not really comparable between studies - as they use mean opinion score as a metric and collect different samples from Amazon Mechnical Turk.
<span style="color:grey; opacity: 0.6">( Image credit: WaveNet: A generative model for raw audio )</span>
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Deep Speech Synthesis from Multimodal Articulatory Representations
Region-Based Optimization in Continual Learning for Audio Deepfake Detection
ProsodyFM: Unsupervised Phrasing and Intonation Control for Intelligible Speech Synthesis
AMuSeD: An Attentive Deep Neural Network for Multimodal Sarcasm Detection Incorporating Bi-modal Data Augmentation
CosyVoice 2: Scalable Streaming Speech Synthesis with Large Language Models
Efficient Generative Modeling with Residual Vector Quantization-Based Tokens
Zero-Shot Mono-to-Binaural Speech Synthesis
Multimodal Latent Language Modeling with Next-Token Diffusion
Towards Controllable Speech Synthesis in the Era of Large Language Models: A Survey
Analytic Study of Text-Free Speech Synthesis for Raw Audio using a Self-Supervised Learning Model
Visatronic: A Multimodal Decoder-Only Model for Speech Synthesis
VQalAttent: a Transparent Speech Generation Pipeline based on Transformer-learned VQ-VAE Latent Space
SmoothCache: A Universal Inference Acceleration Technique for Diffusion Transformers
Debatts: Zero-Shot Debating Text-to-Speech Synthesis
Complete reconstruction of the tongue contour through acoustic to articulatory inversion using real-time MRI data
EmoSphere++: Emotion-Controllable Zero-Shot Text-to-Speech via Emotion-Adaptive Spherical Vector
Augmenting Polish Automatic Speech Recognition System With Synthetic Data
Lina-Speech: Gated Linear Attention is a Fast and Parameter-Efficient Learner for text-to-speech synthesis
Fast and High-Quality Auto-Regressive Speech Synthesis via Speculative Decoding
Mitigating Unauthorized Speech Synthesis for Voice Protection
Get Large Language Models Ready to Speak: A Late-fusion Approach for Speech Generation
STTATTS: Unified Speech-To-Text And Text-To-Speech Model
Making Social Platforms Accessible: Emotion-Aware Speech Generation with Integrated Text Analysis
Continuous Speech Synthesis using per-token Latent Diffusion
A Unified Framework for Collecting Text-to-Speech Synthesis Datasets for 22 Indian Languages
DurIAN-E 2: Duration Informed Attention Network with Adaptive Variational Autoencoder and Adversarial Learning for Expressive Text-to-Speech Synthesis
DART: Disentanglement of Accent and Speaker Representation in Multispeaker Text-to-Speech
Accelerating Codec-based Speech Synthesis with Multi-Token Prediction and Speculative Decoding
Beyond Oversmoothing: Evaluating DDPM and MSE for Scalable Speech Synthesis in ASR
Everyday Speech in the Indian Subcontinent
DMOSpeech: Direct Metric Optimization via Distilled Diffusion Model in Zero-Shot Speech Synthesis
Bahasa Harmony: A Comprehensive Dataset for Bahasa Text-to-Speech Synthesis with Discrete Codec Modeling of EnGen-TTS
Efficient training strategies for natural sounding speech synthesis and speaker adaptation based on FastPitch
HALL-E: Hierarchical Neural Codec Language Model for Minute-Long Zero-Shot Text-to-Speech Synthesis
Adversarial Attacks and Robust Defenses in Speaker Embedding based Zero-Shot Text-to-Speech System
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.