Sparsifying Sparse Representations for Passage Retrieval by Top-$k$ Masking
원문 초록
Sparse lexical representation learning has demonstrated much progress in improving passage retrieval effectiveness in recent models such as DeepImpact, uniCOIL, and SPLADE. This paper describes a straightforward yet effective approach for sparsifying lexical representations for passage retrieval, building on SPLADE by introducing a top-$k$ masking scheme to control sparsity and a self-learning method to coax masked representations to mimic unmasked representations. A basic implementation of our model is competitive with more sophisticated approaches and achieves a good balance between effectiveness and efficiency. The simplicity of our methods opens the door for future explorations in lexical representation learning for passage retrieval.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
KaLM-Embedding-V2: Superior Training Techniques and Data Inspire A Versatile Embedding Model
Language-Guided Contrastive Audio-Visual Masked Autoencoder with Automatically Generated Audio-Visual-Text Triplets from Videos
H-QuEST: Accelerating Query-by-Example Spoken Term Detection with Hierarchical Indexing
Large-Scale Few-Shot Classification with Semi-supervised Hierarchical k-Probabilistic PCAs
Semantic Structure Enhanced Contrastive Adversarial Hash Network for Cross-media Representation Learning
Adaptive label-aware graph convolutional networks for cross-modal retrieval
토론
이 논문과 연결된 포럼 글이 아직 없습니다.