Cross-Modal Retrieval
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 5
- 평가표
- 13
- 보존된 평가 기록
- 111
Cross-Modal Retrieval (CMR) is a task of retrieving items across different modalities, such as image, text, video, and audio. The core challenge of CMR is the heterogeneity gap, which arises because data from different modalities have distinct representations, making direct comparison difficult. To address this, most CMR methods focus on learning a shared latent embedding space. In this space, concepts from different modalities are projected, allowing their similarity to be measured using a distance metric.
Scene-centric vs. Object-centric Image-Text Cross-modal Retrieval: A Reproducibility Study
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
A Concept-Centric Approach to Multi-Modality Learning
Rebalanced Vision-Language Retrieval Considering Structure-Aware Distillation
ViUniT: Visual Unit Tests for More Robust Visual Programming
CLIP-PING: Boosting Lightweight Vision-Language Models with Proximus Intrinsic Neighbors Guidance
Explainable and Interpretable Multimodal Large Language Models: A Comprehensive Survey
Fusing Physics-Driven Strategies and Cross-Modal Adversarial Learning: Toward Multi-Domain Applications
Multimodal Whole Slide Foundation Model for Pathology
Automatic Prompt Generation and Grounding Object Detection for Zero-Shot Image Anomaly Detection
VLM-HOI: Vision Language Models for Interpretable Human-Object Interaction Analysis
FLEX-CLIP: Feature-Level GEneration Network Enhanced CLIP for X-shot Cross-modal Retrieval
CLIPS: An Enhanced CLIP Framework for Learning with Synthetic Captions
FINECAPTION: Compositional Image Captioning Focusing on Wherever You Want at Any Granularity
Everything is a Video: Unifying Modalities through Next-Frame Prediction
MM-Embed: Universal Multimodal Retrieval with Multimodal LLMs
Exploring Optimal Transport-Based Multi-Grained Alignments for Text-Molecule Retrieval
TaxaBind: A Unified Embedding Space for Ecological Applications
Towards Cross-Modal Text-Molecule Retrieval with Better Modality Alignment
Nearest Neighbor Normalization Improves Multimodal Retrieval
Multilingual Vision-Language Pre-training for the Remote Sensing Domain
EntityCLIP: Entity-Centric Image-Text Matching via Multimodal Attentive Contrastive Learning
Bridging the Modality Gap: Dimension Information Alignment and Sparse Spatial Constraint for Image-Text Matching
Test-time Adaptation for Cross-modal Retrieval with Query Shift
Deep Class-guided Hashing for Multi-label Cross-modal Retrieval
GleanVec: Accelerating vector search with minimalist nonlinear dimensionality reduction
MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models
CSA: Data-efficient Mapping of Unimodal Features to Multimodal Features
BadCM: Invisible Backdoor Attack Against Cross-Modal Learning
Multimodal LLM Enhanced Cross-lingual Cross-modal Retrieval
Procedure-Aware Surgical Video-language Pretraining with Hierarchical Knowledge Augmentation
DARE: Diverse Visual Question Answering with Robustness Evaluation
NEVLP: Noise-Robust Framework for Efficient Vision-Language Pre-training
EyeCLIP: A visual-language foundation model for multi-modal ophthalmic image analysis
M3-Jepa: Multimodal Alignment via Multi-directional MoE based on the JEPA framework
Snap and Diagnose: An Advanced Multimodal Retrieval System for Identifying Plant Diseases in the Wild
Evaluating Attribute Comprehension in Large Vision-Language Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.