Analysing the Effect of Clarifying Questions on Document Ranking in Conversational Search
원문 초록
Recent research on conversational search highlights the importance of mixed-initiative in conversations. To enable mixed-initiative, the system should be able to ask clarifying questions to the user. However, the ability of the underlying ranking models (which support conversational search) to account for these clarifying questions and answers has not been analysed when ranking documents, at large. To this end, we analyse the performance of a lexical ranking model on a conversational search dataset with clarifying questions. We investigate, both quantitatively and qualitatively, how different aspects of clarifying questions and user answers affect the quality of ranking. We argue that there needs to be some fine-grained treatment of the entire conversational round of clarification, based on the explicit feedback which is present in such mixed-initiative settings. Informed by our findings, we introduce a simple heuristic-based lexical baseline, that significantly outperforms the existing naive baselines. Our work aims to enhance our understanding of the challenges present in this particular task and inform the design of more appropriate conversational ranking models.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Precise Zero-Shot Pointwise Ranking with LLMs through Post-Aggregated Global Context Information
ConvSearch-R1: Enhancing Query Reformulation for Conversational Search with Reasoning via Reinforcement Learning
Efficient Conversational Search via Topical Locality in Dense Retrieval
How do Large Language Models Understand Relevance? A Mechanistic Interpretability Perspective
Distillation and Refinement of Reasoning in Small Language Models for Document Re-ranking
Dense Passage Retrieval in Conversational Search
토론
이 논문과 연결된 포럼 글이 아직 없습니다.