| VLAB |
- Accuracy
- 0.61
|
VLAB: Enhancing Video Language Pre-training by Feature Adapting and Blending 2023-05-22 |
연결 없음 |
| MA-LMM |
- Accuracy
- 0.606
|
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding 2024-04-08 |
코드 1 |
| MaMMUT (ours) |
- Accuracy
- .602
|
MaMMUT: A Simple Architecture for Joint Learning for MultiModal Tasks 2023-03-29 |
코드 1 |
| VALOR |
- Accuracy
- 0.60
|
VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset 2023-04-17 |
코드 1 |
| VAST |
- Accuracy
- 0.60
|
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset 2023-05-29 |
코드 1 · 코드 2 |
| COSA |
- Accuracy
- 0.60
|
COSA: Concatenated Sample Pretrained Vision-Language Foundation Model 2023-06-15 |
코드 1 |
| mPLUG-2 |
- Accuracy
- 0.581
|
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video 2023-02-01 |
코드 1 · 코드 2 · 코드 3 · 코드 4 |
| VideoCoCa |
- Accuracy
- 0.569
|
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners 2022-12-09 |
연결 없음 |
| GIT |
- Accuracy
- 0.568
|
GIT: A Generative Image-to-text Transformer for Vision and Language 2022-05-27 |
코드 1 |
| FrozenBiLM+ |
- Accuracy
- 0.558
|
Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Models 2023-08-18 |
코드 1 |
| HiTeA |
- Accuracy
- 0.556
|
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training 2022-12-30 |
연결 없음 |
| InternVideo |
- Accuracy
- 0.555
|
InternVideo: General Video Foundation Models via Generative and Discriminative Learning 2022-12-06 |
코드 1 · 코드 2 |
| UMT-L (ViT-L/16) |
- Accuracy
- 0.552
|
Unmasked Teacher: Towards Training-Efficient Video Foundation Models 2023-03-28 |
코드 1 |
| vid-TLDR (UMT-L) |
- Accuracy
- 0.549
|
vid-TLDR: Training Free Token merging for Light-weight Video Transformer 2024-03-20 |
코드 1 |
| VIOLETv2 |
- Accuracy
- 0.547
|
An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling 2022-09-04 |
코드 1 |
| MuLTI |
- Accuracy
- 0.547
|
MuLTI: Efficient Video-and-Language Understanding with Text-Guided MultiWay-Sampler and Multiple Choice Modeling 2023-03-10 |
연결 없음 |
| X2-VLM (large) |
- Accuracy
- 0.546
|
X$^2$-VLM: All-In-One Pre-trained Model For Vision-Language Tasks 2022-11-22 |
코드 1 · 코드 2 |
| X2-VLM (base) |
- Accuracy
- 0.528
|
X$^2$-VLM: All-In-One Pre-trained Model For Vision-Language Tasks 2022-11-22 |
코드 1 · 코드 2 |
| Clover |
- Accuracy
- 0.524
|
Clover: Towards A Unified Video-Language Alignment and Fusion Model 2022-07-16 |
코드 1 |
| VIOLET + MELTR |
- Accuracy
- 0.517
|
MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models 2023-03-23 |
코드 1 |
| OmniVL |
- Accuracy
- 0.510
|
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks 2022-09-15 |
연결 없음 |
| VIOLET+ |
- Accuracy
- 0.495
|
Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Models 2023-08-18 |
코드 1 |
| Co-Tokenization |
- Accuracy
- .486
|
Video Question Answering with Iterative Video-Text Co-Tokenization 2022-08-01 |
연결 없음 |
| All-in-one-B |
- Accuracy
- 0.483
|
All in One: Exploring Unified Video-Language Pre-training 2022-03-14 |
코드 1 |
| LRCE |
- Accuracy
- 0.478
|
Lightweight Recurrent Cross-modal Encoder for Video Question Answering 2023-06-30 |
코드 1 |
| JustAsk+ |
- Accuracy
- 0.477
|
Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Models 2023-08-18 |
코드 1 |
| GIT+MDF |
- Accuracy
- 0.469
|
Self-Adaptive Sampling for Efficient Video Question-Answering on Image--Text Models 2023-07-09 |
코드 1 · 코드 2 |
| AIO+MIF |
- Accuracy
- 0.467
|
Self-Adaptive Sampling for Efficient Video Question-Answering on Image--Text Models 2023-07-09 |
코드 1 · 코드 2 |
| ALPRO |
- Accuracy
- 0.459
|
Align and Prompt: Video-and-Language Pre-training with Entity Prompts 2021-12-17 |
코드 1 |
| All-in-one+ |
- Accuracy
- 0.438
|
Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Models 2023-08-18 |
코드 1 |