arXiv:1910.06737
Integrating Temporal and Spatial Attentions for VATEX Video Captioning Challenge 2019
원문 초록
This notebook paper presents our model in the VATEX video captioning challenge. In order to capture multi-level aspects in the video, we propose to integrate both temporal and spatial attentions for video captioning. The temporal attentive module focuses on global action movements while spatial attentive module enables to describe more fine-grained objects. Considering these two types of attentive modules are complementary, we thus fuse them via a late fusion strategy. The proposed model significantly outperforms baselines and achieves 73.4 CIDEr score on the testing set which ranks the second place at the VATEX video captioning challenge leaderboard 2019.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
UGC-VideoCaptioner: An Omni UGC Video Detail Caption Model and New Benchmarks
video-SALMONN 2: Captioning-Enhanced Audio-Visual Large Language Models
FLASH: Latent-Aware Semi-Autoregressive Speculative Decoding for Multimodal Tasks
FocusedAD: Character-centric Movie Audio Description
Caption Anything in Video: Fine-grained Object-centric Captioning via Spatiotemporal Multimodal Prompting
Pretrained Image-Text Models are Secretly Video Captioners
토론
이 논문과 연결된 포럼 글이 아직 없습니다.