Adversarial speech for voice privacy protection from Personalized Speech generation
원문 초록
The rapid progress in personalized speech generation technology, including personalized text-to-speech (TTS) and voice conversion (VC), poses a challenge in distinguishing between generated and real speech for human listeners, resulting in an urgent demand in protecting speakers' voices from malicious misuse. In this regard, we propose a speaker protection method based on adversarial attacks. The proposed method perturbs speech signals by minimally altering the original speech while rendering downstream speech generation models unable to accurately generate the voice of the target speaker. For validation, we employ the open-source pre-trained YourTTS model for speech generation and protect the target speaker's speech in the white-box scenario. Automatic speaker verification (ASV) evaluations were carried out on the generated speech as the assessment of the voice protection capability. Our experimental results show that we successfully perturbed the speaker encoder of the YourTTS model using the gradient-based I-FGSM adversarial perturbation method. Furthermore, the adversarial perturbation is effective in preventing the YourTTS model from generating the speech of the target speaker. Audio samples can be found in https://voiceprivacy.github.io/Adeversarial-Speech-with-YourTTS.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Prediction
An Exhaustive Evaluation of TTS- and VC-based Data Augmentation for ASR
Bts-e: Audio deepfake detection using breathing-talking-silence encoder
ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching
Differentiable Reward Optimization for LLM based TTS system
PresentAgent: Multimodal Agent for Presentation Video Generation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.