← Video Retrieval
Papers with Code · CC BY-SA 4.0

DiDeMo

아카이브 평가 40건 · 마지막 적재/변경

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델원본 지표·값논문구현
InternVideo2-6B
text-to-video R@1
74.2
video-to-text R@1
71.9
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
2024-03-22
코드 1 · 코드 2
vid-TLDR (UMT-L)
text-to-video R@1
72.3
text-to-video R@5
91.2
text-to-video R@10
94.2
video-to-text R@1
68.5
video-to-text R@10
93.8
video-to-text R@5
89.8
vid-TLDR: Training Free Token merging for Light-weight Video Transformer
2024-03-20
코드 1
VAST
text-to-video R@1
72.0
text-to-video R@5
89.0
text-to-video R@10
91.4
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
2023-05-29
코드 1 · 코드 2
COSA
text-to-video R@1
70.5
COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
2023-06-15
코드 1
UMT-L (ViT-L/16)
text-to-video R@1
70.4
text-to-video R@5
90.1
text-to-video R@10
93.5
video-to-text R@1
65.7
video-to-text R@10
93.3
video-to-text R@5
89.6
Unmasked Teacher: Towards Training-Efficient Video Foundation Models
2023-03-28
코드 1
GRAM
text-to-video R@1
67.3
text-to-video R@10
90.1
video-to-text R@1
63.5
video-to-text R@10
91.6
Gramian Multimodal Representation Learning and Alignment
2024-12-16
코드 1 · 코드 2
VALOR
text-to-video R@1
61.5
text-to-video R@5
85.3
text-to-video R@10
90.4
VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
2023-04-17
코드 1
TESTA (ViT-B/16)
text-to-video R@1
61.2
text-to-video R@5
87.2
text-to-video R@10
91.5
TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding
2023-10-29
코드 1
VindLU
text-to-video R@1
61.2
text-to-video R@5
85.8
text-to-video R@10
91.0
VindLU: A Recipe for Effective Video-and-Language Pretraining
2022-12-09
코드 1
InternVideo
text-to-video R@1
57.9
video-to-text R@1
59.1
InternVideo: General Video Foundation Models via Generative and Discriminative Learning
2022-12-06
코드 1 · 코드 2
RTQ
text-to-video R@1
57.6
text-to-video R@5
84.1
text-to-video R@10
89.9
RTQ: Rethinking Video-language Understanding Based on Image-text Model
2023-12-01
코드 1 · 코드 2
VLAB
text-to-video R@1
56.8
text-to-video R@5
81.6
text-to-video R@10
88.7
VLAB: Enhancing Video Language Pre-training by Feature Adapting and Blending
2023-05-22
연결 없음
HiTeA
text-to-video R@1
56.5
text-to-video R@5
81.7
text-to-video R@10
89.7
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
2022-12-30
연결 없음
MuLTI
text-to-video R@1
56.5
text-to-video R@5
80.2
text-to-video R@10
87.0
MuLTI: Efficient Video-and-Language Understanding with Text-Guided MultiWay-Sampler and Multiple Choice Modeling
2023-03-10
연결 없음
mPLUG-2
text-to-video R@1
56.4
text-to-video R@5
79.1
text-to-video R@10
85.2
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
2023-02-01
코드 1 · 코드 2 · 코드 3 · 코드 4
CLIP-ViP
text-to-video R@1
55.3
text-to-video R@5
82
text-to-video R@10
89.3
text-to-video Median Rank
1
CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment
2022-09-14
코드 1
STAN
text-to-video R@1
54.6
text-to-video R@5
78.4
text-to-video R@10
85.1
text-to-video Median Rank
1
Revisiting Temporal Modeling for CLIP-based Image-to-Video Knowledge Transferring
2023-01-26
코드 1
Singularity
text-to-video R@1
53.9
text-to-video R@5
79.4
text-to-video R@10
86.9
Revealing Single Frame Bias for Video-and-Language Learning
2022-06-07
코드 1 · 코드 2
DMAE (ViT-B/32)
text-to-video R@1
52.7
text-to-video R@5
79.3
text-to-video R@10
86.6
text-to-video Median Rank
1.0
text-to-video Mean Rank
10.5
Dual-Modal Attention-Enhanced Text-Video Retrieval with Triplet Partial Margin Contrastive Learning
2023-09-20
코드 1
HunYuan_tvr (huge)
text-to-video R@1
52.7
text-to-video R@5
77.8
text-to-video R@10
85.2
text-to-video Median Rank
1.0
text-to-video Mean Rank
13.7
video-to-text R@1
54.1
video-to-text R@10
86.8
video-to-text Median Rank
1.0
video-to-text Mean Rank
9.1
video-to-text R@5
78.3
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
2022-04-07
연결 없음
OmniVL
text-to-video R@1
52.4
text-to-video R@5
79.5
text-to-video R@10
85.4
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks
2022-09-15
연결 없음
HunYuan_tvr
text-to-video R@1
52.1
text-to-video R@5
78.2
text-to-video R@10
85.7
text-to-video Median Rank
1
text-to-video Mean Rank
11.1
video-to-text R@1
54.8
video-to-text R@10
87.2
video-to-text Median Rank
1
video-to-text Mean Rank
7.1
video-to-text R@5
79.9
Tencent Text-Video Retrieval: Hierarchical Cross-Modal Interactions with Multi-Level Representations
2022-04-07
연결 없음
Cap4Video
text-to-video R@1
52.0
text-to-video R@5
79.4
text-to-video R@10
87.5
text-to-video Median Rank
1
text-to-video Mean Rank
10.5
video-to-text R@1
51.2
video-to-text R@10
87.4
video-to-text Median Rank
1
video-to-text Mean Rank
7.3
video-to-text R@5
78.5
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
2022-12-31
코드 1 · 코드 2 · 코드 3 · 코드 4
Clover
text-to-video R@1
50.1
text-to-video R@5
76.7
text-to-video R@10
85.6
text-to-video Median Rank
1
Clover: Towards A Unified Video-Language Alignment and Fusion Model
2022-07-16
코드 1
DRL
text-to-video R@1
49.0
text-to-video R@5
76.5
text-to-video R@10
84.5
text-to-video Median Rank
2.0
text-to-video Mean Rank
11.5
video-to-text R@1
49.9
video-to-text R@10
83.3
video-to-text Median Rank
2
video-to-text Mean Rank
7.9
Disentangled Representation Learning for Text-Video Retrieval
2022-03-14
코드 1 · 코드 2
DiffusionRet+QB-Norm
text-to-video R@1
48.9
text-to-video R@5
75.5
text-to-video R@10
83.3
text-to-video Median Rank
2.0
text-to-video Mean Rank
14.1
video-to-text R@1
50.3
video-to-text R@10
82.9
video-to-text Median Rank
1.0
video-to-text Mean Rank
10.3
video-to-text R@5
75.1
DiffusionRet: Generative Text-Video Retrieval with Diffusion Model
2023-03-17
코드 1 · 코드 2 · 코드 3 · 코드 4
PAU
text-to-video R@1
48.6
text-to-video R@5
76.0
text-to-video R@10
84.5
text-to-video Median Rank
2.0
text-to-video Mean Rank
12.9
video-to-text R@1
48.1
video-to-text R@10
85.7
video-to-text Median Rank
2.0
video-to-text Mean Rank
9.8
video-to-text R@5
74.2
Prototype-based Aleatoric Uncertainty Quantification for Cross-modal Retrieval
2023-09-29
코드 1
VIOLETv2
text-to-video R@1
47.9
text-to-video R@5
76.5
text-to-video R@10
84.1
An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling
2022-09-04
코드 1
X-CLIP
text-to-video R@1
47.8
text-to-video R@5
79.3
text-to-video Mean Rank
12.6
video-to-text R@1
47.8
video-to-text R@10
76.8
video-to-text Mean Rank
10.5
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval
2022-07-15
코드 1 · 코드 2 · 코드 3
HBI
text-to-video R@1
46.9
text-to-video R@5
74.9
text-to-video R@10
82.7
text-to-video Median Rank
2.0
text-to-video Mean Rank
12.1
video-to-text R@1
46.2
video-to-text R@10
82.7
video-to-text Median Rank
2.0
video-to-text Mean Rank
8.7
video-to-text R@5
73.0
Video-Text as Game Players: Hierarchical Banzhaf Interaction for Cross-Modal Representation Learning
2023-03-25
코드 1 · 코드 2 · 코드 3 · 코드 4