| InternVideo2-6B |
- Top-1 Accuracy
- 91.9
|
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding 2024-03-22 |
코드 1 · 코드 2 |
| TubeVit-H |
- Top-1 Accuracy
- 91.8
- Top-5 Accuracy
- 98.9
|
Rethinking Video ViTs: Sparse Video Tubes for Joint Image and Video Learning 2022-12-06 |
코드 1 |
| InternVideo2-1B |
- Top-1 Accuracy
- 91.6
|
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding 2024-03-22 |
코드 1 · 코드 2 |
| TubeVit-L |
- Top-1 Accuracy
- 91.5
- Top-5 Accuracy
- 98.7
|
Rethinking Video ViTs: Sparse Video Tubes for Joint Image and Video Learning 2022-12-06 |
코드 1 |
| InternVideo-T |
- Top-1 Accuracy
- 91.3
|
InternVideo: General Video Foundation Models via Generative and Discriminative Learning 2022-12-06 |
코드 1 · 코드 2 |
| 🍷MerlotReserve-Large (+Audio) |
- Top-1 Accuracy
- 91.1
- Top-5 Accuracy
- 97.1
|
MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound 2022-01-07 |
연결 없음 |
| TubeVit-B |
- Top-1 Accuracy
- 90.9
- Top-5 Accuracy
- 97.3
|
Rethinking Video ViTs: Sparse Video Tubes for Joint Image and Video Learning 2022-12-06 |
코드 1 |
| UMT-L (ViT-L/16) |
- Top-1 Accuracy
- 90.5
- Top-5 Accuracy
- 98.8
|
Unmasked Teacher: Towards Training-Efficient Video Foundation Models 2023-03-28 |
코드 1 |
| MTV-H (WTS 60M) |
- Top-1 Accuracy
- 90.3
- Top-5 Accuracy
- 98.5
|
Multiview Transformers for Video Recognition 2022-01-12 |
코드 1 |
| UniFormerV2-L |
- Top-1 Accuracy
- 90.1
- Top-5 Accuracy
- 98.5
|
UniFormerV2: Spatiotemporal Learning by Arming Image ViTs with Video UniFormer 2022-09-22 |
코드 1 · 코드 2 |
| VideoMAE V2-g (64x266x266) |
- Top-1 Accuracy
- 89.9
- Top-5 Accuracy
- 98.5
|
VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking 2023-03-29 |
코드 1 |
| mPLUG-2 |
- Top-1 Accuracy
- 89.8
- Top-5 Accuracy
- 98.3
|
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video 2023-02-01 |
코드 1 · 코드 2 · 코드 3 · 코드 4 |
| EVA |
- Top-1 Accuracy
- 89.8%
|
EVA: Exploring the Limits of Masked Visual Representation Learning at Scale 2022-11-14 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 |
| 🍷MerlotReserve-Base (+Audio) |
- Top-1 Accuracy
- 89.7
- Top-5 Accuracy
- 96.6
|
MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound 2022-01-07 |
연결 없음 |
| 🍷MerlotReserve-Large (no Audio) |
- Top-1 Accuracy
- 89.4
- Top-5 Accuracy
- 96.3
|
MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound 2022-01-07 |
연결 없음 |
| CoCa (finetuned) |
- Top-1 Accuracy
- 89.4
|
CoCa: Contrastive Captioners are Image-Text Foundation Models 2022-05-04 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 |
| VideoMAE V2-g |
- Top-1 Accuracy
- 88.8
- Top-5 Accuracy
- 98.2
|
VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking 2023-03-29 |
코드 1 |
| Hiera-H (no extra data) |
- Top-1 Accuracy
- 88.8
|
Hiera: A Hierarchical Vision Transformer without the Bells-and-Whistles 2023-06-01 |
코드 1 · 코드 2 · 코드 3 · 코드 4 |
| CoCa (frozen) |
- Top-1 Accuracy
- 88.5
|
CoCa: Contrastive Captioners are Image-Text Foundation Models 2022-05-04 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 |
| MaskFeat (no extra data, MViT-L) |
- Top-1 Accuracy
- 88.3
- Top-5 Accuracy
- 98.0
|
Masked Feature Prediction for Self-Supervised Visual Pre-Training 2021-12-16 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 |
| X-CLIP(ViT-L/14, CLIP) |
- Top-1 Accuracy
- 88.3
- Top-5 Accuracy
- 97.7
|
Expanding Language-Image Pretrained Models for General Video Recognition 2022-08-04 |
코드 1 · 코드 2 |
| 🍷MerlotReserve-Base (no Audio) |
- Top-1 Accuracy
- 88.1
- Top-5 Accuracy
- 95.8
|
MERLOT Reserve: Neural Script Knowledge through Vision and Language and Sound 2022-01-07 |
연결 없음 |
| MViTv2-L (ImageNet-21k pretrain) |
- Top-1 Accuracy
- 87.9
- Top-5 Accuracy
- 97.9
|
MViTv2: Improved Multiscale Vision Transformers for Classification and Detection 2021-12-02 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8 · 코드 9 |
| CoVeR (JFT-3B) |
- Top-1 Accuracy
- 87.9
- Top-5 Accuracy
- 97.8
|
Co-training Transformer with Videos and Images Improves Action Recognition 2021-12-14 |
연결 없음 |
| Florence (curated FLD-900M pretrain) |
- Top-1 Accuracy
- 87.8
- Top-5 Accuracy
- 97.9
|
Florence: A New Foundation Model for Computer Vision 2021-11-22 |
코드 1 · 코드 2 |
| CoVeR (JFT-300M) |
- Top-1 Accuracy
- 86.8
- Top-5 Accuracy
- 97.3
|
Co-training Transformer with Videos and Images Improves Action Recognition 2021-12-14 |
연결 없음 |
| TokenLearner 16at18 w. Fuser (L/10) |
- Top-1 Accuracy
- 86.3
- Top-5 Accuracy
- 97.0
|
TokenLearner: What Can 8 Learned Tokens Do for Images and Videos? 2021-06-21 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8 · 코드 9 · 코드 10 · 코드 11 |
| Swin-L (384x384, ImageNet-21k pretrain) |
- Top-1 Accuracy
- 86.1
- Top-5 Accuracy
- 97.3
|
Video Swin Transformer 2021-06-24 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8 · 코드 9 · 코드 10 · 코드 11 · 코드 12 · 코드 13 · 코드 14 · 코드 15 |
| ViViT-H/16x2 (JFT) |
- Top-1 Accuracy
- 85.8
- Top-5 Accuracy
- 96.5
|
ViViT: A Video Vision Transformer 2021-03-29 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8 · 코드 9 · 코드 10 |
| MViTv2-L (train from scratch) |
- Top-1 Accuracy
- 85.5
|
MViTv2: Improved Multiscale Vision Transformers for Classification and Detection 2021-12-02 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8 · 코드 9 |