https://github.com/ArminS03/CAREL
공식 코드CAREL: Instruction-guided reinforcement learning with cross-modal auxiliary objectives
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
The objective of video retrieval is as follows: given a text query and a pool of candidate videos, select the video which corresponds to the text query. Typically, the videos are returned as a ranked list of candidates and scored via document retrieval metrics.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
CAREL: Instruction-guided reinforcement learning with cross-modal auxiliary objectives
CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval
Self-supervised Video Representation Learning Using Inter-intra Contrastive Framework
Pretext-Contrastive Learning: Toward Good Practices in Self-supervised Video Representation Leaning
Aligning Step-by-Step Instructional Diagrams to Video Demonstrations
Video-adverb retrieval with compositional adverb-action embeddings
CiCo: Domain-Aware Sign Language Retrieval via Cross-Lingual Contrastive Learning
ECLIPSE: Efficient Long-range Video Retrieval using Sight and Sound
Where Does It Exist: Spatio-Temporal Video Grounding for Multi-Form Sentences
Side4Video: Spatial-Temporal Side Network for Memory-Efficient Image-to-Video Transfer Learning
Knowing Your Target: Target-Aware Transformer Makes Better Spatio-Temporal Video Grounding
Video Joint Modelling Based on Hierarchical Transformer for Co-summarization
ViSiL: Fine-grained Spatio-Temporal Video Similarity Learning
Robustness Analysis of Video-Language Models Against Visual and Language Perturbations
UniPT: Universal Parallel Tuning for Transfer Learning with Efficient Parameter and Memory
RSPNet: Relative Speed Perception for Unsupervised Video Representation Learning
HANet: Hierarchical Alignment Networks for Video-Text Retrieval
RTQ: Rethinking Video-language Understanding Based on Image-text Model
Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understanding
A Simple Transformer-Based Model for Ego4D Natural Language Queries Challenge
VALOR: Vision-Audio-Language Omni-Perception Pretraining Model and Dataset
Self-supervised Co-training for Video Representation Learning
Memory-augmented Dense Predictive Coding for Video Representation Learning
VALUE: A Multi-Task Benchmark for Video-and-Language Understanding Evaluation
ContextIQ: A Multimodal Expert-Based Video Retrieval System for Contextual Advertising
Enhancing Subsequent Video Retrieval via Vision-Language Models (VLMs)
ConTra: (Con)text (Tra)nsformer for Cross-Modal Video Retrieval
TEACHTEXT: CrossModal Generalized Distillation for Text-Video Retrieval
mPLUG-2: A Modularized Multi-modal Foundation Model Across Text, Image and Video
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.