Exploring Timbre Disentanglement in Non-Autoregressive Cross-Lingual Text-to-Speech
원문 초록
In this paper, we study the disentanglement of speaker and language representations in non-autoregressive cross-lingual TTS models from various aspects. We propose a phoneme length regulator that solves the length mismatch problem between IPA input sequence and monolingual alignment results. Using the phoneme length regulator, we present a FastPitch-based cross-lingual model with IPA symbols as input representations. Our experiments show that language-independent input representations (e.g. IPA symbols), an increasing number of training speakers, and explicit modeling of speech variance information all encourage non-autoregressive cross-lingual TTS model to disentangle speaker and language representations. The subjective evaluation shows that our proposed model can achieve decent naturalness and speaker similarity in cross-language voice cloning.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Few-Shot Speech Deepfake Detection Adaptation with Gaussian Processes
ClonEval: An Open Voice Cloning Benchmark
Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens
IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
Optimizing Multilingual Text-To-Speech with Accents & Emotions
CloneShield: A Framework for Universal Perturbation Against Zero-Shot Voice Cloning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.