https://github.com/minjoong507/MPGN
공식 코드Modal-specific Pseudo Query Generation for Video Corpus Moment Retrieval
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Moment retrieval can de defined as the task of "localizing moments in a video given a user query".
Description from: QVHIGHLIGHTS: Detecting Moments and Highlights in Videos via Natural Language Queries
Image credit: QVHIGHLIGHTS: Detecting Moments and Highlights in Videos via Natural Language Queries
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Modal-specific Pseudo Query Generation for Video Corpus Moment Retrieval
Background-aware Moment Detection for Video Moment Retrieval
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding
LD-DETR: Loop Decoder DEtection TRansformer for Video Moment Retrieval and Highlight Detection
Video Moment Retrieval from Text Queries via Single Frame Annotation
TVR-Ranking: A Dataset for Ranked Video Moment Retrieval with Imprecise Queries
Joint Moment Retrieval and Highlight Detection Via Natural Language Queries
TimeLoc: A Unified End-to-End Framework for Precise Timestamp Localization in Long Videos
The Surprising Effectiveness of Multimodal Large Language Models for Video Moment Retrieval
LLaVA-MR: Large Language-and-Vision Assistant for Video Moment Retrieval
UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection
Correlation-Guided Query-Dependency Calibration for Video Temporal Grounding
Query-Dependent Video Representation for Moment Retrieval and Highlight Detection
R^2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding
UniMD: Towards Unifying Moment Retrieval and Temporal Action Detection
Towards Diverse Temporal Grounding under Single Positive Labels
FlashVTG: Feature Layering and Adaptive Score Handling Network for Video Temporal Grounding
SHINE: Saliency-aware HIerarchical NEgative Ranking for Compositional Temporal Grounding
Going for GOAL: A Resource for Grounded Football Commentaries
UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection
TMR: Text-to-Motion Retrieval Using Contrastive 3D Human Motion Synthesis
UMT: Unified Multi-modal Transformers for Joint Video Moment Retrieval and Highlight Detection
TimeSuite: Improving MLLMs for Long Video Understanding via Grounded Tuning
VLG-Net: Video-Language Graph Matching Network for Video Grounding
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.