DSBERT:Unsupervised Dialogue Structure learning with BERT
원문 초록
Unsupervised dialogue structure learning is an important and meaningful task in natural language processing. The extracted dialogue structure and process can help analyze human dialogue, and play a vital role in the design and evaluation of dialogue systems. The traditional dialogue system requires experts to manually design the dialogue structure, which is very costly. But through unsupervised dialogue structure learning, dialogue structure can be automatically obtained, reducing the cost of developers constructing dialogue process. The learned dialogue structure can be used to promote the dialogue generation of the downstream task system, and improve the logic and consistency of the dialogue robot's reply.In this paper, we propose a Bert-based unsupervised dialogue structure learning algorithm DSBERT (Dialogue Structure BERT). Different from the previous SOTA models VRNN and SVRNN, we combine BERT and AutoEncoder, which can effectively combine context information. In order to better prevent the model from falling into the local optimal solution and make the dialogue state distribution more uniform and reasonable, we also propose three balanced loss functions that can be used for dialogue structure learning. Experimental results show that DSBERT can generate a dialogue structure closer to the real structure, can distinguish sentences with different semantics and map them to different hidden states.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
ZipVoice-Dialog: Non-Autoregressive Spoken Dialogue Generation with Flow Matching
SDialog: A Python Toolkit for Synthetic Dialogue Generation and Analysis
Enhancing Medical Dialogue Generation through Knowledge Refinement and Dynamic Prompt Adjustment
Efficient Tuning of Large Language Models for Knowledge-Grounded Dialogue Generation
VisTai: Benchmarking Vision-Language Models for Traditional Chinese in Taiwan
SAGE: Steering and Refining Dialog Generation with State-Action Augmentation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.