← Zero-Shot Video Retrieval
Papers with Code · CC BY-SA 4.0

DiDeMo

아카이브 평가 26건 · 마지막 적재/변경

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델원본 지표·값논문구현
InternVideo2-6B
text-to-video R@1
57.9
text-to-video R@5
80.0
text-to-video R@10
84.6
video-to-text R@1
57.1
video-to-text R@5
79.9
video-to-text R@10
85.0
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
2024-03-22
코드 1 · 코드 2
InternVideo2-1B
text-to-video R@1
57.0
text-to-video R@5
80.0
text-to-video R@10
85.1
video-to-text R@1
54.3
video-to-text R@5
77.2
video-to-text R@10
83.5
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
2024-03-22
코드 1 · 코드 2
VAST
text-to-video R@1
55.5
text-to-video R@5
74.3
text-to-video R@10
79.6
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
2023-05-29
코드 1 · 코드 2
GRAM
text-to-video R@1
54.2
text-to-video R@10
80.7
video-to-text R@1
52.3
video-to-text R@10
80.3
Gramian Multimodal Representation Learning and Alignment
2024-12-16
코드 1 · 코드 2
vid-TLDR (UMT-L)
text-to-video R@1
52.0
text-to-video R@5
74.0
text-to-video R@10
81.0
video-to-text R@1
52.0
video-to-text R@5
75.9
video-to-text R@10
83.8
vid-TLDR: Training Free Token merging for Light-weight Video Transformer
2024-03-20
코드 1
UMT-L (ViT-L/16)
text-to-video R@1
48.6
text-to-video R@5
72.9
text-to-video R@10
79.0
video-to-text R@1
49.9
video-to-text R@5
74.8
video-to-text R@10
81.4
Unmasked Teacher: Towards Training-Efficient Video Foundation Models
2023-03-28
코드 1
mPLUG-2
text-to-video R@1
45.7
text-to-video R@5
71.1
text-to-video R@10
79.2
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
2023-02-01
코드 1 · 코드 2 · 코드 3 · 코드 4
HiTeA-17M
text-to-video R@1
43.2
text-to-video R@5
69.3
text-to-video R@10
79.0
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
2022-12-30
연결 없음
LanguageBind(ViT-H/14)
text-to-video R@1
39.9
text-to-video R@5
66.1
text-to-video R@10
74.6
video-to-text R@1
39.8
text-to-video Median Rank
2
video-to-text R@5
67.8
video-to-text R@10
76.2
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
2023-10-03
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6
LanguageBind(ViT-L/14)
text-to-video R@1
39.7
text-to-video R@5
65.5
text-to-video R@10
73.8
video-to-text R@1
38.4
text-to-video Median Rank
2.0
video-to-text R@5
66.6
video-to-text R@10
77.9
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
2023-10-03
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6
Singularity-17M
text-to-video R@1
37.1
text-to-video R@5
61.7
text-to-video R@10
69.9
Revealing Single Frame Bias for Video-and-Language Learning
2022-06-07
코드 1 · 코드 2
Singularity-5M
text-to-video R@1
36.9
text-to-video R@5
61.1
text-to-video R@10
69.3
Revealing Single Frame Bias for Video-and-Language Learning
2022-06-07
코드 1 · 코드 2
HiTeA-5M
text-to-video R@1
36.1
text-to-video R@5
60.1
text-to-video R@10
70.3
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
2022-12-30
연결 없음
BT-Adapter
text-to-video R@1
35.6
text-to-video R@5
61.9
text-to-video R@10
72.6
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
2023-09-27
코드 1
OmniVL
text-to-video R@1
33.3
text-to-video R@5
58.7
text-to-video R@10
68.5
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks
2022-09-15
연결 없음
InternVideo
text-to-video R@1
31.5
text-to-video R@5
57.6
text-to-video R@10
68.2
video-to-text R@1
33.5
video-to-text R@5
60.3
video-to-text R@10
71.1
InternVideo: General Video Foundation Models via Generative and Discriminative Learning
2022-12-06
코드 1 · 코드 2
Clover
text-to-video R@1
29.5
text-to-video R@5
55.2
text-to-video R@10
66.3
text-to-video Median Rank
4
Clover: Towards A Unified Video-Language Alignment and Fusion Model
2022-07-16
코드 1
MILES
text-to-video R@1
27.2
text-to-video R@5
50.3
text-to-video R@10
63.6
text-to-video Median Rank
5.0
MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval
2022-04-26
코드 1
Y. Ge et. al.
text-to-video R@1
25.6
text-to-video R@5
50.6
text-to-video R@10
61.1
text-to-video Median Rank
5.0
Bridging Video-text Retrieval with Multiple Choice Questions
2022-01-13
코드 1 · 코드 2
ALPRO
text-to-video R@1
23.8
text-to-video R@5
47.3
text-to-video R@10
57.9
text-to-video Median Rank
6
Align and Prompt: Video-and-Language Pre-training with Entity Prompts
2021-12-17
코드 1
OA-Trans
text-to-video R@1
23.5
text-to-video R@5
50.4
text-to-video R@10
59.8
text-to-video Median Rank
6.0
Object-aware Video-language Pre-training for Retrieval
2021-12-01
코드 1
VIOLET
text-to-video R@1
23.5
text-to-video R@5
49.8
text-to-video R@10
59.8
VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling
2021-11-24
코드 1
LaT
text-to-video R@1
22.6
text-to-video R@5
45.9
text-to-video R@10
58.9
video-to-text R@1
22.5
text-to-video Median Rank
7
video-to-text R@5
45.2
video-to-text R@10
56.8
video-to-text Median Rank
7
LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval
2022-07-11
연결 없음
FROZEN
text-to-video R@1
21.1
text-to-video R@5
46.0
text-to-video R@10
56.2
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
2021-04-01
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5
M. Bain et. al.
text-to-video R@1
20.2
text-to-video R@5
46.4
text-to-video R@10
58.5
text-to-video Median Rank
7
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
2021-04-01
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5
VideoCLIP
text-to-video R@1
16.6
text-to-video R@5
46.9
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding
2021-09-28
코드 1 · 코드 2