Latent linguistic embedding for cross-lingual text-to-speech and voice conversion
원문 초록
As the recently proposed voice cloning system, NAUTILUS, is capable of cloning unseen voices using untranscribed speech, we investigate the feasibility of using it to develop a unified cross-lingual TTS/VC system. Cross-lingual speech generation is the scenario in which speech utterances are generated with the voices of target speakers in a language not spoken by them originally. This type of system is not simply cloning the voice of the target speaker, but essentially creating a new voice that can be considered better than the original under a specific framing. By using a well-trained English latent linguistic embedding to create a cross-lingual TTS and VC system for several German, Finnish, and Mandarin speakers included in the Voice Conversion Challenge 2020, we show that our method not only creates cross-lingual VC with high speaker similarity but also can be seamlessly used for cross-lingual TTS without having to perform any extra steps. However, the subjective evaluations of perceived naturalness seemed to vary between target speakers, which is one aspect for future improvement.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Few-Shot Speech Deepfake Detection Adaptation with Gaussian Processes
ClonEval: An Open Voice Cloning Benchmark
Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens
IndexTTS: An Industrial-Level Controllable and Efficient Zero-Shot Text-To-Speech System
Metis: A Foundation Speech Generation Model with Masked Generative Pre-training
Overview of the Amphion Toolkit (v0.2)
토론
이 논문과 연결된 포럼 글이 아직 없습니다.