Improving Limited Labeled Dialogue State Tracking with Self-Supervision
원문 초록
Existing dialogue state tracking (DST) models require plenty of labeled data. However, collecting high-quality labels is costly, especially when the number of domains increases. In this paper, we address a practical DST problem that is rarely discussed, i.e., learning efficiently with limited labeled data. We present and investigate two self-supervised objectives: preserving latent consistency and modeling conversational behavior. We encourage a DST model to have consistent latent distributions given a perturbed input, making it more robust to an unseen scenario. We also add an auxiliary utterance generation task, modeling a potential correlation between conversational behavior and dialogue states. The experimental results show that our proposed self-supervised signals can improve joint goal accuracy by 8.95\% when only 1\% labeled data is used on the MultiWOZ dataset. We can achieve an additional 1.76\% improvement if some unlabeled data is jointly trained as semi-supervised learning. We analyze and visualize how our proposed self-supervised signals help the DST task and hope to stimulate future data-efficient DST research.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Know Your Mistakes: Towards Preventing Overreliance on Task-Oriented Conversational AI Through Accountability Modeling
Beyond Ontology in Dialogue State Tracking for Goal-Oriented Chatbot
A Zero-Shot Open-Vocabulary Pipeline for Dialogue Understanding
Confidence Estimation for LLM-Based Dialogue State Tracking
Continual Dialogue State Tracking via Reason-of-Select Distillation
TaSL: Continual Dialog State Tracking via Task Skill Localization and Consolidation
토론
이 논문과 연결된 포럼 글이 아직 없습니다.