← Cross-Modal Retrieval
Papers with Code · CC BY-SA 4.0

COCO 2014

아카이브 평가 36건 · 마지막 적재/변경

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델원본 지표·값논문구현
VAST
Text-to-image R@1
68.0
Text-to-image R@10
92.8
Text-to-image R@5
87.7
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
2023-05-29
코드 1 · 코드 2
X2-VLM (large)
Image-to-text R@1
84.4
Image-to-text R@10
98.5
Image-to-text R@5
96.5
Text-to-image R@1
67.7
Text-to-image R@10
92.5
Text-to-image R@5
87.5
X$^2$-VLM: All-In-One Pre-trained Model For Vision-Language Tasks
2022-11-22
코드 1 · 코드 2
BEiT-3
Image-to-text R@1
84.8
Image-to-text R@10
98.3
Image-to-text R@5
96.5
Text-to-image R@1
67.2
Text-to-image R@10
87.7
Text-to-image R@5
92.8
Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks
2022-08-22
코드 1 · 코드 2
XFM (base)
Image-to-text R@1
84.2
Image-to-text R@10
98.4
Image-to-text R@5
96.4
Text-to-image R@1
67.0
Text-to-image R@10
92.4
Text-to-image R@5
87.2
Toward Building General Foundation Models for Language, Vision, and Vision-Language Understanding Tasks
2023-01-12
코드 1
X2-VLM (base)
Image-to-text R@1
83.5
Image-to-text R@10
98.5
Image-to-text R@5
96.3
Text-to-image R@1
66.2
Text-to-image R@10
92.2
Text-to-image R@5
87.1
X$^2$-VLM: All-In-One Pre-trained Model For Vision-Language Tasks
2022-11-22
코드 1 · 코드 2
PTP-BLIP (14M)
Image-to-text R@1
81.5
Image-to-text R@10
97.9
Image-to-text R@5
95.9
Text-to-image R@1
64.9
Text-to-image R@10
92.2
Text-to-image R@5
87.4
Position-guided Text Prompt for Vision-Language Pre-training
2022-12-19
코드 1
OmniVL (14M)
Image-to-text R@1
82.1
Image-to-text R@10
98.1
Image-to-text R@5
95.9
Text-to-image R@1
64.8
Text-to-image R@10
91.6
Text-to-image R@5
86.1
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks
2022-09-15
연결 없음
VSE-Gradient
Image-to-text R@1
81.4
Image-to-text R@10
97.9
Image-to-text R@5
95.6
Text-to-image R@1
63.6
Text-to-image R@10
91.5
Text-to-image R@5
86.0
Dissecting Deep Metric Learning Losses for Image-Text Retrieval
2022-10-21
코드 1 · 코드 2
X-VLM (base)
Image-to-text R@1
81.2
Image-to-text R@10
98.2
Image-to-text R@5
95.6
Text-to-image R@1
63.4
Text-to-image R@10
91.5
Text-to-image R@5
85.8
Multi-Grained Vision Language Pre-Training: Aligning Texts with Visual Concepts
2021-11-16
코드 1
Florence
Image-to-text R@1
81.8
Image-to-text R@5
95.2
Text-to-image R@1
63.2
Text-to-image R@5
85.7
Florence: A New Foundation Model for Computer Vision
2021-11-22
코드 1 · 코드 2
VK-OOD
Image-to-text R@1
80.7
Image-to-text R@10
96.8
Image-to-text R@5
95.1
Text-to-image R@1
62.9
Text-to-image R@10
92.8
Text-to-image R@5
84.8
Implicit Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis
2023-09-21
코드 1
Aurora (ours, r=128)
Image-to-text R@1
80.7
Image-to-text R@10
97.8
Image-to-text R@5
95.3
Text-to-image R@1
62.8
Text-to-image R@10
91
Text-to-image R@5
84.8
연결 없음
논문 날짜 미기재
연결 없음
DSMD
Image-to-text R@1
48.0
Image-to-text R@10
84.5
Image-to-text R@5
75.6
Text-to-image R@1
62.1
Text-to-image R@10
92.0
Text-to-image R@5
85.9
Dynamic Self-adaptive Multiscale Distillation from Pre-trained Multimodal Large Model for Efficient Cross-modal Representation Learning
2024-04-16
코드 1
VALOR
Text-to-image R@1
61.4
Text-to-image R@10
90.9
Text-to-image R@5
84.4
VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
2023-04-17
코드 1
ALBEF
Image-to-text R@1
77.6
Image-to-text R@10
97.2
Image-to-text R@5
94.3
Text-to-image R@1
60.7
Text-to-image R@10
90.5
Text-to-image R@5
84.3
Align before Fuse: Vision and Language Representation Learning with Momentum Distillation
2021-07-16
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6
ALIGN
Image-to-text R@1
77
Image-to-text R@10
96.9
Image-to-text R@5
93.5
Text-to-image R@1
59.9
Text-to-image R@10
89.8
Text-to-image R@5
83.3
Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervision
2021-02-11
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5
ERNIE-ViL 2.0
Image-to-text R@1
77.4
Image-to-text R@10
97.1
Image-to-text R@5
93.6
Text-to-image R@1
59.5
Text-to-image R@10
90.1
Text-to-image R@5
83.4
ERNIE-ViL 2.0: Multi-view Contrastive Learning for Image-Text Pre-training
2022-09-30
코드 1
TCL
Image-to-text R@1
75.6
Image-to-text R@10
96.7
Image-to-text R@5
92.8
Text-to-image R@1
59.0
Text-to-image R@10
89.9
Text-to-image R@5
83.2
Vision-Language Pre-Training with Triple Contrastive Learning
2022-02-21
코드 1
Oscar
Image-to-text R@1
73.5
Image-to-text R@10
96.0
Image-to-text R@5
92.2
Text-to-image R@1
57.5
Text-to-image R@10
89.8
Text-to-image R@5
82.8
Oscar: Object-Semantics Aligned Pre-training for Vision-Language Tasks
2020-04-13
코드 1 · 코드 2 · 코드 3 · 코드 4
METER
Image-to-text R@1
76.16
Image-to-text R@10
96.82
Image-to-text R@5
93.16
Text-to-image R@1
57.08
Text-to-image R@10
90.07
Text-to-image R@5
82.66
An Empirical Study of Training End-to-End Vision-and-Language Transformers
2021-11-03
코드 1 · 코드 2 · 코드 3
ViSTA
Image-to-text R@1
68.9
Image-to-text R@10
95.4
Image-to-text R@5
90.1
Text-to-image R@1
52.6
Text-to-image R@10
87.6
Text-to-image R@5
79.6
ViSTA: Vision and Scene Text Aggregation for Cross-Modal Retrieval
2022-03-31
연결 없음
ALADIN
Image-to-text R@1
64.9
Image-to-text R@10
94.5
Image-to-text R@5
88.6
Text-to-image R@1
51.3
Text-to-image R@10
87.5
Text-to-image R@5
79.2
ALADIN: Distilling Fine-grained Alignment Scores for Efficient Image-Text Matching and Retrieval
2022-07-29
코드 1
3SHNet
Image-to-text R@1
67.9
Image-to-text R@10
95.4
Image-to-text R@5
90.5
Text-to-image R@1
50.3
Text-to-image R@10
87.7
Text-to-image R@5
79.3
3SHNet: Boosting Image-Sentence Retrieval via Visual Semantic-Spatial Self-Highlighting
2024-04-26
코드 1
VisualSparta
Text-to-image R@1
44.4
Text-to-image R@10
82.4
Text-to-image R@5
72.8
VisualSparta: An Embarrassingly Simple Approach to Large-scale Text-to-Image Search with Weighted Bag-of-words
2021-01-01
코드 1
RCAR
Image-to-text R@1
61.3
Image-to-text R@10
92.6
Image-to-text R@5
86.1
Text-to-image R@1
44.3
Text-to-image R@10
83.2
Text-to-image R@5
73.2
Plug-and-Play Regulators for Image-Text Matching
2023-03-23
코드 1
NAPReg
Image-to-text R@1
59.8
Text-to-image R@1
43.0
NAPReg: Nouns As Proxies Regularization for Semantically Aware Cross-Modal Embeddings
2023-01-07
코드 1
ViLT-B/32
Image-to-text R@1
61.5
Image-to-text R@10
92.7
Image-to-text R@5
86.3
Text-to-image R@1
42.7
Text-to-image R@10
83.1
Text-to-image R@5
72.9
ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision
2021-02-05
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6
SGRAF
Image-to-text R@1
57.8
Image-to-text R@10
91.6
Image-to-text R@5
84.9
Text-to-image R@1
41.9
Text-to-image R@10
81.3
Text-to-image R@5
70.7
Similarity Reasoning and Filtration for Image-Text Matching
2021-01-05
코드 1
LILE
Image-to-text R@1
55.6
Image-to-text R@10
91.0
Image-to-text R@5
82.4
Text-to-image R@1
41.5
Text-to-image R@10
82.2
Text-to-image R@5
72.1
LILE: Look In-Depth before Looking Elsewhere -- A Dual Attention Network using Transformers for Cross-Modal Information Retrieval in Histopathology Archives
2022-03-02
연결 없음
VSRN
Image-to-text R@1
53.0
Image-to-text R@10
89.4
Image-to-text R@5
81.1
Text-to-image R@1
40.5
Text-to-image R@10
81.1
Text-to-image R@5
70.6
Visual Semantic Reasoning for Image-Text Matching
2019-09-06
코드 1 · 코드 2