https://github.com/ArrowLuo/CLIP4Clip
공식 코드CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Zero-shot video retrieval is the task of retrieving relevant videos based on a query (usually in text form) without any prior training on specific examples of those videos. Unlike traditional retrieval methods that rely on supervised learning with annotated datasets, zero-shot retrieval leverages pre-trained models, typically based on large-scale vision-language learning, to understand semantic relationships between textual descriptions and video content.
This approach enables retrieval of unseen video concepts by generalizing knowledge from diverse training data, making it highly useful for domains with limited labeled data, such as broadcast media, surveillance, and historical archives.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
End-to-End Learning of Visual Representations from Uncurated Instructional Videos
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text
Seeing What You Miss: Vision-Language Pre-training with Semantic Completion Learning
Clover: Towards A Unified Video-Language Alignment and Fusion Model
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
Advancing High-Resolution Video-Language Representation with Large-Scale Video Transcriptions
vid-TLDR: Training Free Token merging for Light-weight Video Transformer
Everything at Once -- Multi-modal Fusion Transformer for Video Retrieval
HowToCaption: Prompting LLMs to Transform Video Annotations at Scale
Make Your Training Flexible: Towards Deployment-Efficient Video Models
InternVideo: General Video Foundation Models via Generative and Discriminative Learning
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
Unmasked Teacher: Towards Training-Efficient Video Foundation Models
VideoCLIP: Contrastive Pre-training for Zero-shot Video-Text Understanding
Align and Prompt: Video-and-Language Pre-training with Entity Prompts
Bridging Video-text Retrieval with Multiple Choice Questions
VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.