StreamVC: Real-Time Low-Latency Voice Conversion
원문 초록
We present StreamVC, a streaming voice conversion solution that preserves the content and prosody of any source speech while matching the voice timbre from any target speech. Unlike previous approaches, StreamVC produces the resulting waveform at low latency from the input signal even on a mobile platform, making it applicable to real-time communication scenarios like calls and video conferencing, and addressing use cases such as voice anonymization in these scenarios. Our design leverages the architecture and training strategy of the SoundStream neural audio codec for lightweight high-quality speech synthesis. We demonstrate the feasibility of learning soft speech units causally, as well as the effectiveness of supplying whitened fundamental frequency information to improve pitch stability without leaking the source timbre information.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Region-Based Optimization in Continual Learning for Audio Deepfake Detection
SALF-MOS: Speaker Agnostic Latent Features Downsampled for MOS Prediction
ArVoice: A Multi-Speaker Dataset for Arabic Speech Synthesis
Investigating self-supervised features for expressive, multilingual voice conversion
Generative Adversarial Network based Voice Conversion: Techniques, Challenges, and Recent Advancements
FADEL: Uncertainty-aware Fake Audio Detection with Evidential Deep Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.