Cross-Modal Retrieval
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 5
- 평가표
- 13
- 보존된 평가 기록
- 111
Cross-Modal Retrieval (CMR) is a task of retrieving items across different modalities, such as image, text, video, and audio. The core challenge of CMR is the heterogeneity gap, which arises because data from different modalities have distinct representations, making direct comparison difficult. To address this, most CMR methods focus on learning a shared latent embedding space. In this space, concepts from different modalities are projected, allowing their similarity to be measured using a distance metric.
Scene-centric vs. Object-centric Image-Text Cross-modal Retrieval: A Reproducibility Study
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Advancing Visual Grounding with Scene Knowledge: Benchmark and Method
PiTL: Cross-modal Retrieval with Weakly-supervised Vision-language Pre-training via Prompting
A scoping review on multimodal deep learning in biomedical images and texts
UniFine: A Unified and Fine-grained Approach for Zero-shot Vision-Language Understanding
Alternative Telescopic Displacement: An Efficient Multimodal Alignment Method
Cross-modal transformers for infrared and visible image fusion
Quilt-1M: One Million Image-Text Pairs for Histopathology
RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing
RemoteCLIP: A Vision Language Foundation Model for Remote Sensing
Reducing Semantic Confusion: Scene-aware Aggregation Network for Remote Sensing Cross-modal Retrieval
Youku-mPLUG: A 10 Million Large-scale Chinese Video-Language Dataset for Pre-training and Benchmarks
MolFM: A Multimodal Molecular Foundation Model
Towards Unified Text-based Person Retrieval: A Large-scale Multi-Attribute and Language Search Benchmark
Revisiting the Role of Language Priors in Vision-Language Models
End-to-end Knowledge Retrieval with Multi-modal Queries
Dense and Aligned Captions (DAC) Promote Compositional Reasoning in VL Models
Improved Probabilistic Image-Text Representations
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
Multimodal Relation Extraction with Cross-Modal Retrieval and Synthesis
Are Diffusion Models Vision-And-Language Reasoners?
Discffusion: Discriminative Diffusion Models as Few-shot Vision and Language Learners
LLMScore: Unveiling the Power of Large Language Models in Text-to-Image Synthesis Evaluation
MALM: Mask Augmentation based Local Matching for Food-Recipe Retrieval
Probing the Role of Positional Information in Vision-Language Models
Continual Vision-Language Representation Learning with Off-Diagonal Information
ImageBind: One Embedding Space To Bind Them All
Scene Text Recognition with Image-Text Matching-guided Dictionary
Cross-Modal Retrieval for Motion and Text via DopTriple Loss
Instance-Variant Loss with Gaussian RBF Kernel for 3D Cross-modal Retriveal
Category-Oriented Representation Learning for Image to Multi-Modal Retrieval
Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations
Vision Meets Definitions: Unsupervised Visual Word Sense Disambiguation Incorporating Gloss Information
Deep Lifelong Cross-modal Hashing
Sample-Specific Debiasing for Better Image-Text Models
RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Models
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.