https://github.com/Guaranteer/VidSTG-Dataset
공식 코드Where Does It Exist: Spatio-Temporal Video Grounding for Multi-Form Sentences
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Video grounding is the task of linking spoken language descriptions to specific video segments. In video grounding, the model is given a video and a natural language description, such as a sentence or a caption, and its goal is to identify the specific segment of the video that corresponds to the description. This can involve tasks such as localizing the objects or actions mentioned in the description within the video, or associating a specific time interval with the description.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Where Does It Exist: Spatio-Temporal Video Grounding for Multi-Form Sentences
Knowing Your Target: Target-Aware Transformer Makes Better Spatio-Temporal Video Grounding
Animal Kingdom: A Large and Diverse Dataset for Animal Behavior Understanding
A Simple Transformer-Based Model for Ego4D Natural Language Queries Challenge
LLaVA-ST: A Multimodal Large Language Model for Fine-Grained Spatial-Temporal Understanding
Reinforcement Learning Tuning for VideoLLMs: Reward Design and Data Efficiency
Can I Trust Your Answer? Visually Grounded Video Question Answering
Towards Parameter-Efficient Integration of Pre-Trained Language Models In Temporal Video Grounding
Prior Knowledge Integration via LLM Encoding and Pseudo Event Regulation for Video Moment Retrieval
Connecting Vision and Language with Video Localized Narratives
CONE: An Efficient COarse-to-fiNE Alignment Framework for Long Video Temporal Grounding
Text-Visual Prompting for Efficient 2D Temporal Video Grounding
OmniSTVG: Toward Spatio-Temporal Omni-Object Video Grounding
Knowing Where to Focus: Event-aware Transformer for Video Grounding
Embracing Consistency: A One-Stage Approach for Spatio-Temporal Video Grounding
Dual-Path Temporal Map Optimization for Make-up Temporal Video Grounding
Cross-modal Contrastive Learning with Asymmetric Co-attention Network for Video Moment Retrieval
Exploring Iterative Refinement with Diffusion Models for Video Grounding
Negative Sample Matters: A Renaissance of Metric Learning for Temporal Grounding
VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning
Interventional Video Grounding with Dual Contrastive Learning
Consistency of Compositional Generalization across Multiple Levels
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
InternVideo2: Scaling Foundation Models for Multimodal Video Understanding
Artemis: Towards Referential Understanding in Complex Videos
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.