Densifying Sparse Representations for Passage Retrieval by Representational Slicing
원문 초록
Learned sparse and dense representations capture different successful approaches to text retrieval and the fusion of their results has proven to be more effective and robust. Prior work combines dense and sparse retrievers by fusing their model scores. As an alternative, this paper presents a simple approach to densifying sparse representations for text retrieval that does not involve any training. Our densified sparse representations (DSRs) are interpretable and can be easily combined with dense representations for end-to-end retrieval. We demonstrate that our approach can jointly learn sparse and dense representations within a single model and then combine them for dense retrieval. Experimental results suggest that combining our DSRs and dense representations yields a balanced tradeoff between effectiveness and efficiency.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Tree-Based Text Retrieval via Hierarchical Clustering in RAGFrameworks: Application on Taiwanese Regulations
TableRAG: A Retrieval Augmented Generation Framework for Heterogeneous Document Reasoning
MSTAR: Box-free Multi-query Scene Text Retrieval with Attention Recycling
GLAP: General contrastive audio-text pretraining across domains and languages
Adding simple structure at inference improves Vision-Language Compositionality
DiscoVLA: Discrepancy Reduction in Vision, Language, and Alignment for Parameter-Efficient Video-Text Retrieval
토론
이 논문과 연결된 포럼 글이 아직 없습니다.