Video Description
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
The goal of automatic Video Description is to tell a story about events happening in a video. While early Video Description methods produced captions for short clips that were manually segmented to contain a single event of interest, more recently dense video captioning has been proposed to both segment distinct events in time and describe them in a series of coherent sentences. This problem is a generalization of dense image region captioning and has many practical applications, such as generating textual summaries for the visually impaired, or detecting and describing important events in surveillance footage.
Source: Joint Event Detection and Description in Continuous Video Streams
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Synchronized Audio-Visual Frames with Fractional Positional Encoding for Transformers in Video-to-Text Translation
Relational Graph Learning for Grounded Video Description Generation
NarrationBot and InfoBot: A Hybrid System for Automated Video Description
Visual-aware Attention Dual-stream Decoder for Video Captioning
Boosting Video Captioning with Dynamic Loss Network
Efficient data-driven encoding of scene motion using Eccentricity
The Role of the Input in Natural Language Video Description
Unbox the Blackbox: Predict and Interpret YouTube Viewership Using Deep Learning
MSVD-Turkish: A Comprehensive Multimodal Dataset for Integrated Vision and Language Research in Turkish
A Comprehensive Review on Recent Methods and Challenges of Video Description
Identity-Aware Multi-Sentence Video Description
Describing Unseen Videos via Multi-Modal Cooperative Dialog Agents
Active Learning for Video Description With Cluster-Regularized Ensemble Ranking
Delving Deeper into the Decoder for Video Captioning
Multi-Layer Content Interaction Through Quaternion Product For Visual Question Answering
VizSeq: A Visual Analysis Toolkit for Text Generation Tasks
Prediction and Description of Near-Future Activities in Video
VATEX: A Large-Scale, High-Quality Multilingual Dataset for Video-and-Language Research
End-to-End Video Captioning
Grounded Video Description
Adversarial Inference for Multi-Sentence Video Description
Attentive Sequence to Sequence Translation for Localizing Clips of Interest by Natural Language Descriptions
End-to-End Audio Visual Scene-Aware Dialog using Multimodal Attention-Based Video Features
Video Description: A Survey of Methods, Datasets and Evaluation Metrics
Audio Visual Scene-Aware Dialog (AVSD) Challenge at DSTC7
Integrating both Visual and Audio Cues for Enhanced Video Caption
Attend and Interact: Higher-Order Object Interactions for Video Understanding
Predicting Visual Features from Text for Image and Video Caption Retrieval
Egocentric Video Description based on Temporally-Linked Sequences
Attention-Based Multimodal Fusion for Video Description
Hierarchical Boundary-Aware Neural Encoder for Video Captioning
Memory-augmented Attention Modelling for Videos
VideoMCC: a New Benchmark for Video Comprehension
Bidirectional Long-Short Term Memory for Video Description
A Mid-level Video Representation based on Binary Descriptors: A Case Study for Pornography Detection
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.