Modelling low-resource accents without accent-specific TTS frontend
원문 초록
This work focuses on modelling a speaker's accent that does not have a dedicated text-to-speech (TTS) frontend, including a grapheme-to-phoneme (G2P) module. Prior work on modelling accents assumes a phonetic transcription is available for the target accent, which might not be the case for low-resource, regional accents. In our work, we propose an approach whereby we first augment the target accent data to sound like the donor voice via voice conversion, then train a multi-speaker multi-accent TTS model on the combination of recordings and synthetic data, to generate the donor's voice speaking in the target accent. Throughout the procedure, we use a TTS frontend developed for the same language but a different accent. We show qualitative and quantitative analysis where the proposed strategy achieves state-of-the-art results compared to other generative models. Our work demonstrates that low resource accents can be modelled with relatively little data and without developing an accent-specific TTS frontend. Audio samples of our model converting to multiple accents are available on our web page.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Metis: A Foundation Speech Generation Model with Masked Generative Pre-training
Overview of the Amphion Toolkit (v0.2)
SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Prediction
An Exhaustive Evaluation of TTS- and VC-based Data Augmentation for ASR
ASVspoof 5: Design, Collection and Validation of Resources for Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speech
Vevo: Controllable Zero-Shot Voice Imitation with Self-Supervised Disentanglement
토론
이 논문과 연결된 포럼 글이 아직 없습니다.