Learning Acoustic Word Embeddings with Temporal Context for Query-by-Example Speech Search
원문 초록
We propose to learn acoustic word embeddings with temporal context for query-by-example (QbE) speech search. The temporal context includes the leading and trailing word sequences of a word. We assume that there exist spoken word pairs in the training database. We pad the word pairs with their original temporal context to form fixed-length speech segment pairs. We obtain the acoustic word embeddings through a deep convolutional neural network (CNN) which is trained on the speech segment pairs with a triplet loss. Shifting a fixed-length analysis window through the search content, we obtain a running sequence of embeddings. In this way, searching for the spoken query is equivalent to the matching of acoustic word embeddings. The experiments show that our proposed acoustic word embeddings learned with temporal context are effective in QbE speech search. They outperform the state-of-the-art frame-level feature representations and reduce run-time computation since no dynamic time warping is required in QbE speech search. We also find that it is important to have sufficient speech segment pairs to train the deep CNN for effective acoustic word embeddings.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Attributes Shape the Embedding Space of Face Recognition Models
ActAlign: Zero-Shot Fine-Grained Video Classification via Language-Guided Sequence Alignment
Characterizing Linguistic Shifts in Croatian News via Diachronic Word Embeddings
Improving Large Language Model Safety with Contrastive Representation Learning
Enhancing Medical Dialogue Generation through Knowledge Refinement and Dynamic Prompt Adjustment
Boosting Vulnerability Detection of LLMs via Curriculum Preference Optimization with Synthetic Reasoning Data
토론
이 논문과 연결된 포럼 글이 아직 없습니다.