https://github.com/HumamAlwassel/TSP
공식 코드TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Most natural videos contain numerous events. For example, in a video of a “man playing a piano”, the video might also contain “another man dancing” or “a crowd clapping”. The task of dense video captioning involves both detecting and describing events in a video.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
TSP: Temporally-Sensitive Pretraining of Video Encoders for Localization Tasks
Joint Event Detection and Description in Continuous Video Streams
Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning
VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning
COM Kitchens: An Unedited Overhead-view Video Dataset as a Vision-Language Benchmark
Unifying Event Detection and Captioning as Sequence Generation via Pre-Training
TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning
Dense-Captioning Events in Videos: SYSU Submission to ActivityNet Challenge 2020
Enhancing Traffic Safety with Parallel Dense Video Captioning for End-to-End Event Analysis
A Better Use of Audio-Visual Cues: Dense Video Captioning with Bi-modal Transformer
Dense Video Captioning Using Unsupervised Semantic Information
OmniVid: A Generative Framework for Universal Video Understanding
Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
Learning Grounded Vision-Language Representation for Versatile Understanding in Untrimmed Videos
Bidirectional Attentive Fusion with Context Gating for Dense Video Captioning
Vid2Seq: Large-Scale Pretraining of a Visual Language Model for Dense Video Captioning
Towards Automatic Learning of Procedures from Web Instructional Videos
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.