Speaker-conditioned Target Speaker Extraction based on Customized LSTM Cells
원문 초록
Speaker-conditioned target speaker extraction systems rely on auxiliary information about the target speaker to extract the target speaker signal from a mixture of multiple speakers. Typically, a deep neural network is applied to isolate the relevant target speaker characteristics. In this paper, we focus on a single-channel target speaker extraction system based on a CNN-LSTM separator network and a speaker embedder network requiring reference speech of the target speaker. In the LSTM layer of the separator network, we propose to customize the LSTM cells in order to only remember the specific voice patterns corresponding to the target speaker by modifying the information processing in the forget gate. Experimental results for two-speaker mixtures using the Librispeech dataset show that this customization significantly improves the target speaker extraction performance compared to using standard LSTM cells.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
M3ANet: Multi-scale and Multi-Modal Alignment Network for Brain-Assisted Target Speaker Extraction
LauraTSE: Target Speaker Extraction using Auto-Regressive Decoder-Only Language Models
Metis: A Foundation Speech Generation Model with Masked Generative Pre-training
Multi-Level Speaker Representation for Target Speaker Extraction
WeSep: A Scalable and Flexible Toolkit Towards Generalizable Target Speaker Extraction
Generative Speech Foundation Model Pretraining for High-Quality Speech Extraction and Restoration
토론
이 논문과 연결된 포럼 글이 아직 없습니다.