Papers with Code 아카이브
Dense Video Captioning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 1
- 평가표
- 4
- 보존된 평가 기록
- 24
Most natural videos contain numerous events. For example, in a video of a “man playing a piano”, the video might also contain “another man dancing” or “a crowd clapping”. The task of dense video captioning involves both detecting and describing events in a video.
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Dense Video Captioning using Graph-based Sentence Summarization
TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generation
Watch and Learn: Leveraging Expert Knowledge and Language for Surgical Video Understanding
VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning
HiCM$^2$: Hierarchical Compact Memory Modeling for Dense Video Captioning
Implicit Location-Caption Alignment via Complementary Masking for Weakly-Supervised Dense Video Captioning
Exploring Temporal Event Cues for Dense Video Captioning in Cyclic Co-learning
Video LLMs for Temporal Reasoning in Long Videos
LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos
VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format
Seq2Time: Sequential Knowledge Transfer for Video LLM Temporal Grounding
Whats in a Video: Factorized Autoregressive Decoding for Online Dense Video Captioning
Technical Report for Soccernet 2023 -- Dense Video Captioning
Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
SoccerNet 2024 Challenges Results
COM Kitchens: An Unedited Overhead-view Video Dataset as a Vision-Language Benchmark
Live Video Captioning
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding
The 8th AI City Challenge
TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning
Enhancing Traffic Safety with Parallel Dense Video Captioning for End-to-End Event Analysis
Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
DIBS: Enhancing Dense Video Captioning with Unlabeled Videos via Pseudo Boundary Enrichment and Online Refinement
Streaming Dense Video Captioning
OmniVid: A Generative Framework for Universal Video Understanding
Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding
VTimeLLM: Empower LLM to Grasp Video Moments
Exo2EgoDVC: Dense Video Captioning of Egocentric Procedural Activities Using Web Instructional Videos
Dense Video Captioning: A Survey of Techniques, Datasets and Evaluation Protocols
Towards Surveillance Video-and-Language Understanding: New Dataset, Baselines, and Challenges
VidChapters-7M: Video Chapters at Scale
SoccerNet 2023 Challenges Results
Zero-Shot Dense Video Captioning by Jointly Optimizing Text and Moment
Visual Transformation Telling
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.