https://github.com/starmemda/CAMoE
공식 코드Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss
RGNet: A Unified Clip Retrieval and Grounding Network for Long Videos
LoVR: A Benchmark for Long Video Retrieval in Multimodal Contexts
Bridging Video-text Retrieval with Multiple Choice Questions
UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection
TransVCL: Attention-enhanced Video Copy Localization Network with Flexible Supervision
Efficient End-to-End Video Question Answering with Pyramidal Multimodal Transformer
An Empirical Study of End-to-End Video-Language Transformers with Masked Visual Modeling
VIOLET : End-to-End Video-Language Transformers with Masked Visual-token Modeling
COSA: Concatenated Sample Pretrained Vision-Language Foundation Model
VAST: A Vision-Audio-Subtitle-Text Omni-Modality Foundation Model and Dataset
Human-centric Spatio-Temporal Video Grounding With Visual Transformers
Contextual Explainable Video Representation: Human Perception-based Understanding
From Play to Replay: Composed Video Retrieval for Temporally Fine-Grained Videos
UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling
Animate-A-Story: Storytelling with Retrieval-Augmented Video Generation
Learning to Locate Visual Answer in Video Corpus Using Question
Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and Data
Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?
MSVD-Indonesian: A Benchmark for Multimodal Video-Text Tasks in Indonesian
VideoRoPE: What Makes for Good Video Rotary Position Embedding?
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection
Learning the Best Pooling Strategy for Visual Semantic Embedding
TimeZero: Temporal Video Grounding with Reasoning-Guided LVLM
Unified Static and Dynamic Network: Efficient Temporal Filtering for Video Grounding
Generalized Few-Shot Video Classification with Video Retrieval and Feature Generation
Temporal Working Memory: Query-Guided Segment Refinement for Enhanced Multimodal Understanding
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval
Temporal Context Aggregation for Video Retrieval with Contrastive Learning
TCGL: Temporal Contrastive Graph for Self-supervised Video Representation Learning
HawkEye: Training Video-Text LLMs for Grounding Text in Videos
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.