Zero-Shot Video Retrieval
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 8
- 보존된 평가 기록
- 126
Zero-shot video retrieval is the task of retrieving relevant videos based on a query (usually in text form) without any prior training on specific examples of those videos. Unlike traditional retrieval methods that rely on supervised learning with annotated datasets, zero-shot retrieval leverages pre-trained models, typically based on large-scale vision-language learning, to understand semantic relationships between textual descriptions and video content.
This approach enables retrieval of unseen video concepts by generalizing knowledge from diverse training data, making it highly useful for domains with limited labeled data, such as broadcast media, surveillance, and historical archives.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Gramian Multimodal Representation Learning and Alignment
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
vid-TLDR: Training Free Token merging for Light-weight Video Transformer
Multi-granularity Correspondence Learning from Long-term Noisy Videos
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale
LanguageBind: Extending Video-Language Pretraining to N-modality by Language-based Semantic Alignment
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
ImageBind: One Embedding Space To Bind Them All
Unmasked Teacher: Towards Training-Efficient Video Foundation Models
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
VideoCoCa: Video-Text Modeling with Zero-Shot Transfer from Contrastive Captioners
InternVideo: General Video Foundation Models via Generative and Discriminative Learning
Seeing What You Miss: Vision-Language Pre-training with Semantic Completion Learning
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks
Clover: Towards A Unified Video-Language Alignment and Fusion Model
LaT: Latent Translation with Cycle-Consistency for Video-Text Retrieval
Revealing Single Frame Bias for Video-and-Language Learning
MILES: Visual BERT Pre-training with Injected Language Semantics for Video-text Retrieval
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
Learning Audio-Video Modalities from Image Captions
Bridging Video-text Retrieval with Multiple Choice Questions
Align and Prompt: Video-and-Language Pre-training with Entity Prompts
Everything at Once -- Multi-modal Fusion Transformer for Video Retrieval
Object-aware Video-language Pre-training for Retrieval
VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling
Florence: A New Foundation Model for Computer Vision
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding
TACo: Token-aware Cascade Contrastive Learning for Video-Text Alignment
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.