UnifieR: A Unified Retriever for Large-Scale Retrieval
원문 초록
Large-scale retrieval is to recall relevant documents from a huge collection given a query. It relies on representation learning to embed documents and queries into a common semantic encoding space. According to the encoding space, recent retrieval methods based on pre-trained language models (PLM) can be coarsely categorized into either dense-vector or lexicon-based paradigms. These two paradigms unveil the PLMs' representation capability in different granularities, i.e., global sequence-level compression and local word-level contexts, respectively. Inspired by their complementary global-local contextualization and distinct representing views, we propose a new learning framework, UnifieR which unifies dense-vector and lexicon-based retrieval in one model with a dual-representing capability. Experiments on passage retrieval benchmarks verify its effectiveness in both paradigms. A uni-retrieval scheme is further presented with even better retrieval quality. We lastly evaluate the model on BEIR benchmark to verify its transferability.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
KaLM-Embedding-V2: Superior Training Techniques and Data Inspire A Versatile Embedding Model
Language-Guided Contrastive Audio-Visual Masked Autoencoder with Automatically Generated Audio-Visual-Text Triplets from Videos
H-QuEST: Accelerating Query-by-Example Spoken Term Detection with Hierarchical Indexing
Semantic Structure Enhanced Contrastive Adversarial Hash Network for Cross-media Representation Learning
Adaptive label-aware graph convolutional networks for cross-modal retrieval
W2VV++: Fully Deep Learning for Ad-hoc Video Search
토론
이 논문과 연결된 포럼 글이 아직 없습니다.