https://github.com/jnzs1836/era-vsum
공식 코드ERA: Entity Relationship Aware Video Summarization with Wasserstein GAN
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
Video Summarization aims to generate a short synopsis that summarizes the video content by selecting its most informative and important parts. The produced summary is usually composed of a set of representative video frames (a.k.a. video key-frames), or video fragments (a.k.a. video key-fragments) that have been stitched in chronological order to form a shorter video. The former type of a video summary is known as video storyboard, and the latter type is known as video skim.
Source: Video Summarization Using Deep Neural Networks: A Survey <br> <span style="color:grey; opacity: 0.6">Image credit: iJRASET</span>
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
ERA: Entity Relationship Aware Video Summarization with Wasserstein GAN
IntentVizor: Towards Generic Query Guided Interactive Video Summarization
VideoXum: Cross-modal Visual and Textural Summarization of Videos
UBiSS: A Unified Framework for Bimodal Semantic Summarization of Videos
An Egocentric Vision-Language Model based Portable Real-time Smart Assistant
Contrastive Losses Are Natural Criteria for Unsupervised Video Summarization
Unsupervised video summarization framework using keyframe extraction and video skimming
Joint Moment Retrieval and Highlight Detection Via Natural Language Queries
CSTA: CNN-based Spatiotemporal Attention for Video Summarization
Video-XL: Extra-Long Vision Language Model for Hour-Scale Video Understanding
MHSCNet: A Multimodal Hierarchical Shot-aware Convolutional Network for Video Summarization
R^2-Tuning: Efficient Image-to-Video Transfer Learning for Video Temporal Grounding
Video Repurposing from User Generated Content: A Large-scale Dataset and Benchmark
Test-Time Training with Self-Supervision for Generalization under Distribution Shifts
Test-Time Training with Self-Supervision for Generalization under Distribution Shifts
GPT2MVS: Generative Pre-trained Transformer-2 for Multi-modal Video Summarization
GPT2MVS: Generative Pre-trained Transformer-2 for Multi-modal Video Summarization
Ultrasound Video Summarization using Deep Reinforcement Learning
Vis-DSS: An Open-Source toolkit for Visual Data Selection and Summarization
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.