https://github.com/rerv/uniadapter
공식 코드UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Video-Text retrieval requires understanding of both video and language together. Therefore it's different to video retrieval task.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss
Improving Video-Text Retrieval by Multi-Stream Corpus Alignment and Dual Softmax Loss
RGNet: A Unified Clip Retrieval and Grounding Network for Long Videos
LoVR: A Benchmark for Long Video Retrieval in Multimodal Contexts
Bridging Video-text Retrieval with Multiple Choice Questions
UniAdapter: Unified Parameter-Efficient Transfer Learning for Cross-modal Modeling
Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and Data
Learning the Best Pooling Strategy for Visual Semantic Embedding
Temporal Working Memory: Query-Guided Segment Refinement for Enhanced Multimodal Understanding
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval
Video-Text Retrieval by Supervised Sparse Multi-Grained Learning
MV-Adapter: Multimodal Video Transfer Learning for Video Text Retrieval
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval
X-CLIP: End-to-End Multi-grained Contrastive Learning for Video-Text Retrieval
Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoning
Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoning
One Trajectory, One Token: Grounded Video Tokenization via Panoptic Sub-object Trajectory
Fine-grained Video-Text Retrieval with Hierarchical Graph Reasoning
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections
InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Tasks
Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrieval
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.