Cross-Modal Retrieval
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 5
- 평가표
- 13
- 보존된 평가 기록
- 111
Cross-Modal Retrieval (CMR) is a task of retrieving items across different modalities, such as image, text, video, and audio. The core challenge of CMR is the heterogeneity gap, which arises because data from different modalities have distinct representations, making direct comparison difficult. To address this, most CMR methods focus on learning a shared latent embedding space. In this space, concepts from different modalities are projected, allowing their similarity to be measured using a distance metric.
Scene-centric vs. Object-centric Image-Text Cross-modal Retrieval: A Reproducibility Study
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
A Prior Instruction Representation Framework for Remote Sensing Image-text Retrieval
Cross-modal Active Complementary Learning with Self-refining Correspondence
InvGC: Robust Cross-Modal Retrieval by Inverse Graph Convolution
Two-Stage Triplet Loss Training with Curriculum Augmentation for Audio-Visual Retrieval
Learning Comprehensive Representations with Richer Self for Text-to-Image Person Re-Identification
Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Banks
PaLI-3 Vision Language Models: Smaller, Faster, Stronger
Direction-Oriented Visual-semantic Embedding Model for Remote Sensing Image-text Retrieval
BioBridge: Bridging Biomedical Foundation Models via Knowledge Graphs
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval
Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored Search
ELIP: Efficient Language-Image Pre-training with Fewer Vision Tokens
Learning From Noisy Correspondence With Tri-Partition for Cross-Modal Matching
Learning Tri-modal Embeddings for Zero-Shot Soundscape Mapping
Sound Source Localization is All about Cross-Modal Alignment
Dynamic Visual Semantic Sub-Embeddings and Fast Re-Ranking
Improving Multimodal Classification of Social Media Posts by Leveraging Image-Text Auxiliary Tasks
Dual-view Curricular Optimal Transport for Cross-lingual Cross-modal Retrieval
Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise Filtering
A Survey on Interpretable Cross-modal Reasoning
ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation
Cross-Modal Retrieval Meets Inference:Improving Zero-Shot Classification with Cross-Modal Retrieval
Multimodal Foundation Models For Echocardiogram Interpretation
Cross-Modal Retrieval: A Systematic Review of Methods and Future Directions
Extending Cross-Modal Retrieval with Interactive Learning to Improve Image Retrieval Performance in Forensics
Video and Audio are Images: A Cross-Modal Mixer for Original Data on Video-Audio Retrieval
Parameter-Efficient Transfer Learning for Remote Sensing Image-Text Retrieval
Uniformly Distributed Category Prototype-Guided Vision-Language Framework for Long-Tail Recognition
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
An Empirical Study of CLIP for Text-based Person Search
Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models
Unifying Two-Stream Encoders with Transformers for Cross-Modal Retrieval
Your Negative May not Be True Negative: Boosting Image-Text Matching with False Negative Elimination
Grounded Image Text Matching with Mismatched Relation Reasoning
CLIP-KD: An Empirical Study of CLIP Model Distillation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.