Automatic Speech Disentanglement for Voice Conversion using Rank Module and Speech Augmentation
원문 초록
Voice Conversion (VC) converts the voice of a source speech to that of a target while maintaining the source's content. Speech can be mainly decomposed into four components: content, timbre, rhythm and pitch. Unfortunately, most related works only take into account content and timbre, which results in less natural speech. Some recent works are able to disentangle speech into several components, but they require laborious bottleneck tuning or various hand-crafted features, each assumed to contain disentangled speech information. In this paper, we propose a VC model that can automatically disentangle speech into four components using only two augmentation functions, without the requirement of multiple hand-crafted features or laborious bottleneck tuning. The proposed model is straightforward yet efficient, and the empirical results demonstrate that our model can achieve a better performance than the baseline, regarding disentanglement effectiveness and speech naturalness.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Unsupervised Rhythm and Voice Conversion to Improve ASR on Dysarthric Speech
Towards Better Disentanglement in Non-Autoregressive Zero-Shot Expressive Voice Conversion
Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching
PromptEVC: Controllable Emotional Voice Conversion with Natural Language Prompts
REWIND: Speech Time Reversal for Enhancing Speaker Representations in Diffusion-based Voice Conversion
From Generality to Mastery: Composer-Style Symbolic Music Generation via Large-Scale Pre-training
토론
이 논문과 연결된 포럼 글이 아직 없습니다.