What's to know? Uncertainty as a Guide to Asking Goal-oriented Questions
원문 초록
One of the core challenges in Visual Dialogue problems is asking the question that will provide the most useful information towards achieving the required objective. Encouraging an agent to ask the right questions is difficult because we don't know a-priori what information the agent will need to achieve its task, and we don't have an explicit model of what it knows already. We propose a solution to this problem based on a Bayesian model of the uncertainty in the implicit model maintained by the visual dialogue agent, and in the function used to select an appropriate output. By selecting the question that minimises the predicted regret with respect to this implicit model the agent actively reduces ambiguity. The Bayesian model of uncertainty also enables a principled method for identifying when enough information has been acquired, and an action should be selected. We evaluate our approach on two goal-oriented dialogue datasets, one for visual-based collaboration task and the other for a negotiation-based task. Our uncertainty-aware information-seeking model outperforms its counterparts in these two challenging problems.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Hawk: Learning to Understand Open-World Video Anomalies
Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models
Collecting Visually-Grounded Dialogue with A Game Of Sorts
PaCE: Unified Multi-modal Dialogue Pre-training with Progressive and Compositional Experts
Unified Multimodal Model with Unlikelihood Training for Visual Dialog
LAVIS: A Library for Language-Vision Intelligence
토론
이 논문과 연결된 포럼 글이 아직 없습니다.