https://github.com/cdjkim/respec
공식 코드ReSpec: Relevance and Specificity Grounded Online Filtering for Learning on Video-Text Data Streams
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
ReSpec: Relevance and Specificity Grounded Online Filtering for Learning on Video-Text Data Streams
Diving Deep into the Motion Representation of Video-Text Models
Helping Hands: An Object-Aware Ego-Centric Video Recognition Model
Vision-Language Pre-training: Basics, Recent Advances, and Future Trends
Revitalize Region Feature for Democratizing Video-Language Pre-training of Retrieval
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Language-Conditioned Change-point Detection to Identify Sub-Tasks in Robotics Domains
Learning Action Changes by Measuring Verb-Adverb Textual Relationships
Can I Trust Your Answer? Visually Grounded Video Question Answering
Temporal Tessellation: A Unified Approach for Video Analysis
3D-CSL: self-supervised 3D context similarity learning for Near-Duplicate Video Retrieval
Differentiable Resolution Compression and Alignment for Efficient Video Classification and Retrieval
Noise Estimation Using Density Estimation for Self-Supervised Multimodal Learning
Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding
EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrieval
ProS: Prompting-to-simulate Generalized knowledge for Universal Cross-Domain Retrieval
Revisiting Temporal Modeling for CLIP-based Image-to-Video Knowledge Transferring
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval
Disentangled Representation Learning for Text-Video Retrieval
Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs
Robust Cross-Modal Knowledge Distillation for Unconstrained Videos
Hybrid Contrastive Quantization for Efficient Cross-View Video Retrieval
COOT: Cooperative Hierarchical Transformer for Video-Text Representation Learning
Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language
VATT: Transformers for Multimodal Self-Supervised Learning from Raw Video, Audio and Text
Connecting Vision and Language with Video Localized Narratives
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.