Papers with Code 아카이브
Video Captioning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 13
- 보존된 평가 기록
- 86
Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text.
Source: NITS-VC System for VATEX Video Captioning Challenge 2020
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
HiCM$^2$: Hierarchical Compact Memory Modeling for Dense Video Captioning
G-VEval: A Versatile Metric for Evaluating Image and Video Captions Using GPT-4o
Implicit Location-Caption Alignment via Complementary Masking for Weakly-Supervised Dense Video Captioning
Exploring Temporal Event Cues for Dense Video Captioning in Cyclic Co-learning
VG-TVP: Multimodal Procedural Planning via Visually Grounded Text-Video Prompting
Bridging Vision and Language: Modeling Causality and Temporality in Video Narratives
Agent-based Video Trimming
ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentation
Video LLMs for Temporal Reasoning in Long Videos
Progress-Aware Video Frame Captioning
LongVALE: Vision-Audio-Language-Event Benchmark Towards Time-Aware Omni-Modal Perception of Long Videos
VideoLLM Knows When to Speak: Enhancing Time-Sensitive Video Comprehension with Video-Text Duet Interaction Format
HyperGLM: HyperGraph for Video Scene Graph Generation and Anticipation
Seq2Time: Sequential Knowledge Transfer for Video LLM Temporal Grounding
FINECAPTION: Compositional Image Captioning Focusing on Wherever You Want at Any Granularity
Whats in a Video: Factorized Autoregressive Decoding for Online Dense Video Captioning
AdaCM$^2$: On Understanding Extremely Long-Term Video with Adaptive Cross-Modality Memory Reduction
Multi-Modal interpretable automatic video captioning
Pseudo-labeling with Keyword Refining for Few-Supervised Video Captioning
SPECTRUM: Semantic Processing and Emotion-informed video-Captioning Through Retrieval and Understanding Modalities
Technical Report for Soccernet 2023 -- Dense Video Captioning
EVC-MF: End-to-end Video Captioning Network with Multi-scale Features
FIOVA: A Multi-Annotator Benchmark for Human-Aligned Video Captioning
It's Just Another Day: Unique Video Captioning by Discriminative Prompting
LVD-2M: A Long-take Video Dataset with Temporally Dense Captions
MMCOMPOSITION: Revisiting the Compositionality of Pre-trained Vision-Language Models
Enhancing Multimodal LLM for Detailed and Accurate Video Captioning using Multi-Round Preference Optimization
Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models
IFCap: Image-like Retrieval and Frequency-based Entity Filtering for Zero-shot Captioning
SoccerNet 2024 Challenges Results
Fine-grained length controllable video captioning with ordinal embeddings
LongVILA: Scaling Long-Context Visual Language Models for Long Videos
SkyScript-100M: 1,000,000,000 Pairs of Scripts and Shooting Scripts for Short Drama
CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer
Dual-path Collaborative Generation Network for Emotional Video Captioning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.