Enhancing Post-Hoc Attributions in Long Document Comprehension via Coarse Grained Answer Decomposition
원문 초록
Accurately attributing answer text to its source document is crucial for developing a reliable question-answering system. However, attribution for long documents remains largely unexplored. Post-hoc attribution systems are designed to map answer text back to the source document, yet the granularity of this mapping has not been addressed. Furthermore, a critical question arises: What exactly should be attributed? This involves identifying the specific information units within an answer that require grounding. In this paper, we propose and investigate a novel approach to the factual decomposition of generated answers for attribution, employing template-based in-context learning. To accomplish this, we utilize the question and integrate negative sampling during few-shot in-context learning for decomposition. This approach enhances the semantic understanding of both abstractive and extractive answers. We examine the impact of answer decomposition by providing a thorough examination of various attribution approaches, ranging from retrieval-based techniques to LLM-based attributors.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Evolving Prompts In-Context: An Open-ended, Self-replicating Perspective
Probing the Geometry of Truth: Consistency and Generalization of Truth Directions in LLMs Across Logical Transformations and Question Answering Tasks
SMMILE: An Expert-Driven Benchmark for Multimodal Medical In-Context Learning
SV-LLM: An Agentic Approach for SoC Security Verification using Large Language Models
Provoking Multi-modal Few-Shot LVLM via Exploration-Exploitation In-Context Learning
Federated In-Context Learning: Iterative Refinement for Improved Answer Quality
토론
이 논문과 연결된 포럼 글이 아직 없습니다.