Learning acoustic word embeddings with phonetically associated triplet network
원문 초록
Previous researches on acoustic word embeddings used in query-by-example spoken term detection have shown remarkable performance improvements when using a triplet network. However, the triplet network is trained using only a limited information about acoustic similarity between words. In this paper, we propose a novel architecture, phonetically associated triplet network (PATN), which aims at increasing discriminative power of acoustic word embeddings by utilizing phonetic information as well as word identity. The proposed model is learned to minimize a combined loss function that was made by introducing a cross entropy loss to the lower layer of LSTM-based triplet network. We observed that the proposed method performs significantly better than the baseline triplet network on a word discrimination task with the WSJ dataset resulting in over 20% relative improvement in recall rate at 1.0 false alarm per hour. Finally, we examined the generalization ability by conducting the out-of-domain test on the RM dataset.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Attributes Shape the Embedding Space of Face Recognition Models
Characterizing Linguistic Shifts in Croatian News via Diachronic Word Embeddings
Improving Large Language Model Safety with Contrastive Representation Learning
Enhancing Medical Dialogue Generation through Knowledge Refinement and Dynamic Prompt Adjustment
Boosting Vulnerability Detection of LLMs via Curriculum Preference Optimization with Synthetic Reasoning Data
MonkeyOCR: Document Parsing with a Structure-Recognition-Relation Triplet Paradigm
토론
이 논문과 연결된 포럼 글이 아직 없습니다.