Video Description
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 0
- 평가표
- 0
- 보존된 평가 기록
- 0
The goal of automatic Video Description is to tell a story about events happening in a video. While early Video Description methods produced captions for short clips that were manually segmented to contain a single event of interest, more recently dense video captioning has been proposed to both segment distinct events in time and describe them in a series of coherent sentences. This problem is a generalization of dense image region captioning and has many practical applications, such as generating textual summaries for the visually impaired, or detecting and describing important events in surveillance footage.
Source: Joint Event Detection and Description in Continuous Video Streams
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
DANTE-AD: Dual-Vision Attention Network for Long-Term Audio Description
Cross-Modal Learning for Music-to-Music-Video Description Generation
VideoA11y: Method and Dataset for Accessible Video Description
AVD2: Accident Video Diffusion for Accident Video Description
Enhancing Video Understanding: Deep Neural Networks for Spatiotemporal Analysis
Tarsier2: Advancing Large Vision-Language Models from Detailed Video Description to Comprehensive Video Understanding
Towards Zero-Shot & Explainable Video Description by Reasoning over Graphs of Events in Space and Time
Implicit Location-Caption Alignment via Complementary Masking for Weakly-Supervised Dense Video Captioning
StoryTeller: Improving Long Video Description through Global Audio-Visual Character Identification
PV-VTT: A Privacy-Centric Dataset for Mission-Specific Anomaly Detection and Natural Language Interpretation
FIOVA: A Multi-Annotator Benchmark for Human-Aligned Video Captioning
VideoCLIP-XL: Advancing Long Description Understanding for Video CLIP Models
Technical Report: Competition Solution For Modelscope-Sora
Kubrick: Multimodal Agent Collaborations for Synthetic Video Generation
SUSTechGAN: Image Generation for Object Detection in Adverse Conditions of Autonomous Driving
https://arxiv.org/abs/2407.00634
LLAVIDAL: A Large LAnguage VIsion Model for Daily Activities of Living
A Labelled Dataset for Sentiment Analysis of Videos on YouTube, TikTok, and Other Sources about the 2024 Outbreak of Measles
Hawk: Learning to Understand Open-World Video Anomalies
TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning
X-VARS: Introducing Explainability in Football Refereeing with Multi-Modal Large Language Model
JMI at SemEval 2024 Task 3: Two-step approach for multimodal ECAC using in-context learning with GPT and instruction-tuned Llama models
Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers
Multi-modal News Understanding with Professionally Labelled Videos (ReutersViLNews)
ActionHub: A Large-scale Action Video Description Dataset for Zero-shot Action Recognition
Attention Based Encoder Decoder Model for Video Captioning in Nepali (2023)
Multi Sentence Description of Complex Manipulation Action Videos
CLearViD: Curriculum Learning for Video Description
Analyzing Political Figures in Real-Time: Leveraging YouTube Metadata for Sentiment Analysis
FunQA: Towards Surprising Video Comprehension
MSVD-Indonesian: A Benchmark for Multimodal Video-Text Tasks in Indonesian
Edit As You Wish: Video Caption Editing with Multi-grained User Control
Fine-grained Audible Video Description
Thinking Hallucination for Video Captioning
What's in a Caption? Dataset-Specific Linguistic Diversity and Its Effect on Visual Description Models and Metrics
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.