CNN-Based Prediction of Frame-Level Shot Importance for Video Summarization
원문 초록
In the Internet, ubiquitous presence of redundant, unedited, raw videos has made video summarization an important problem. Traditional methods of video summarization employ a heuristic set of hand-crafted features, which in many cases fail to capture subtle abstraction of a scene. This paper presents a deep learning method that maps the context of a video to the importance of a scene similar to that is perceived by humans. In particular, a convolutional neural network (CNN)-based architecture is proposed to mimic the frame-level shot importance for user-oriented video summarization. The weights and biases of the CNN are trained extensively through off-line processing, so that it can provide the importance of a frame of an unseen video almost instantaneously. Experiments on estimating the shot importance is carried out using the publicly available database TVSum50. It is shown that the performance of the proposed network is substantially better than that of commonly referred feature-based methods for estimating the shot importance in terms of mean absolute error, absolute error variance, and relative F-measure.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
SD-VSum: A Method and Dataset for Script-Driven Video Summarization
An Egocentric Vision-Language Model based Portable Real-time Smart Assistant
What Is That Talk About? A Video-to-Text Summarization Dataset for Scientific Presentations
Do Language Models Understand Time?
Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark
Does SpatioTemporal information benefit Two video summarization benchmarks?
토론
이 논문과 연결된 포럼 글이 아직 없습니다.