Papers with Code 아카이브
Video Captioning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 13
- 보존된 평가 기록
- 86
Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text.
Source: NITS-VC System for VATEX Video Captioning Challenge 2020
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Show, Tell and Summarize: Dense Video Captioning Using Visual Cue Aided Sentence Summarization
Dense Video Captioning using Graph-based Sentence Summarization
video-SALMONN 2: Captioning-Enhanced Audio-Visual Large Language Models
VersaVid-R1: A Versatile Video Understanding and Reasoning Model from Question Answering to Captioning Tasks
ARGUS: Hallucination and Omission Evaluation in Video-LLMs
Temporal Object Captioning for Street Scene Videos from LiDAR Tracks
FLASH: Latent-Aware Semi-Autoregressive Speculative Decoding for Multimodal Tasks
TimeSoccer: An End-to-End Multimodal Large Language Model for Soccer Commentary Generation
Describe Anything: Detailed Localized Image and Video Captioning
FocusedAD: Character-centric Movie Audio Description
Caption Anything in Video: Fine-grained Object-centric Captioning via Spatiotemporal Multimodal Prompting
The Devil is in the Distributions: Explicit Modeling of Scene Content is Key in Zero-Shot Video Captioning
Watch and Learn: Leveraging Expert Knowledge and Language for Surgical Video Understanding
Get In Video: Add Anything You Want to the Video
Fine-Grained Video Captioning through Scene Graph Consolidation
LongCaptioning: Unlocking the Power of Long Caption Generation in Large Multimodal Models
Pretrained Image-Text Models are Secretly Video Captioners
Capturing Rich Behavior Representations: A Dynamic Action Semantic-Aware Graph Transformer for Video Captioning
VidCapBench: A Comprehensive Benchmark of Video Captioning for Controllable Text-to-Video Generation
Temporal Working Memory: Query-Guided Segment Refinement for Enhanced Multimodal Understanding
MAMS: Model-Agnostic Module Selection Framework for Video Captioning
VidChain: Chain-of-Tasks with Metric-based Direct Preference Optimization for Dense Video Captioning
Classifier-Guided Captioning Across Modalities
CaReBench: A Fine-Grained Benchmark for Video Captioning and Retrieval
Hierarchical Banzhaf Interaction for General Video-Language Representation Learning
PolySmart @ TRECVid 2024 Video Captioning (VTT)
HiCM$^2$: Hierarchical Compact Memory Modeling for Dense Video Captioning
G-VEval: A Versatile Metric for Evaluating Image and Video Captions Using GPT-4o
Implicit Location-Caption Alignment via Complementary Masking for Weakly-Supervised Dense Video Captioning
Exploring Temporal Event Cues for Dense Video Captioning in Cyclic Co-learning
VG-TVP: Multimodal Procedural Planning via Visually Grounded Text-Video Prompting
Bridging Vision and Language: Modeling Causality and Temporality in Video Narratives
Agent-based Video Trimming
ViCaS: A Dataset for Combining Holistic and Pixel-level Video Understanding using Captions with Grounded Segmentation
Video LLMs for Temporal Reasoning in Long Videos
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.