Cross-Modal Information Retrieval
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 0
- 보존된 평가 기록
- 0
Cross-Modal Information Retrieval (CMIR) is the task of finding relevant items across different modalities. For example, given an image, find a text or vice versa. The main challenge in CMIR is known as the heterogeneity gap: since items from different modalities have different data types, the similarity between them cannot be measured directly. Therefore, the majority of CMIR methods published to date attempt to bridge this gap by learning a latent representation space, where the similarity between items from different modalities can be measured.
Source: Scene-centric vs. Object-centric Image-Text Cross-modal Retrieval: A Reproducibility Study
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
A New Fine-grained Alignment Method for Image-text Matching
BirdSAT: Cross-View Contrastive Masked Autoencoders for Bird Species Classification and Mapping
A Prior Instruction Representation Framework for Remote Sensing Image-text Retrieval
Cross-modal Active Complementary Learning with Self-refining Correspondence
InvGC: Robust Cross-Modal Retrieval by Inverse Graph Convolution
Two-Stage Triplet Loss Training with Curriculum Augmentation for Audio-Visual Retrieval
Learning Comprehensive Representations with Richer Self for Text-to-Image Person Re-Identification
Balance Act: Mitigating Hubness in Cross-Modal Retrieval with Query and Gallery Banks
PaLI-3 Vision Language Models: Smaller, Faster, Stronger
Direction-Oriented Visual-semantic Embedding Model for Remote Sensing Image-text Retrieval
BioBridge: Bridging Biomedical Foundation Models via Knowledge Graphs
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval
Align before Search: Aligning Ads Image to Text for Accurate Cross-Modal Sponsored Search
ELIP: Efficient Language-Image Pre-training with Fewer Vision Tokens
Learning From Noisy Correspondence With Tri-Partition for Cross-Modal Matching
Learning Tri-modal Embeddings for Zero-Shot Soundscape Mapping
Sound Source Localization is All about Cross-Modal Alignment
Dynamic Visual Semantic Sub-Embeddings and Fast Re-Ranking
Improving Multimodal Classification of Social Media Posts by Leveraging Image-Text Auxiliary Tasks
Dual-view Curricular Optimal Transport for Cross-lingual Cross-modal Retrieval
Towards Better Multi-modal Keyphrase Generation via Visual Entity Enhancement and Multi-granularity Image Noise Filtering
A Survey on Interpretable Cross-modal Reasoning
ViLTA: Enhancing Vision-Language Pre-training through Textual Augmentation
Cross-Modal Retrieval Meets Inference:Improving Zero-Shot Classification with Cross-Modal Retrieval
Multimodal Foundation Models For Echocardiogram Interpretation
Cross-Modal Retrieval: A Systematic Review of Methods and Future Directions
Extending Cross-Modal Retrieval with Interactive Learning to Improve Image Retrieval Performance in Forensics
Video and Audio are Images: A Cross-Modal Mixer for Original Data on Video-Audio Retrieval
Parameter-Efficient Transfer Learning for Remote Sensing Image-Text Retrieval
Uniformly Distributed Category Prototype-Guided Vision-Language Framework for Long-Tail Recognition
EVE: Efficient Vision-Language Pre-training with Masked Prediction and Modality-Aware MoE
An Empirical Study of CLIP for Text-based Person Search
Towards Grounded Visual Spatial Reasoning in Multi-Modal Vision Language Models
Unifying Two-Stream Encoders with Transformers for Cross-Modal Retrieval
Your Negative May not Be True Negative: Boosting Image-Text Matching with False Negative Elimination
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.