Papers with Code 아카이브
Video Captioning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
- 하위 태스크
- 6
- 평가표
- 13
- 보존된 평가 기록
- 86
Video Captioning is a task of automatic captioning a video by understanding the action and event in the video which can help in the retrieval of the video efficiently through text.
Source: NITS-VC System for VATEX Video Captioning Challenge 2020
논문
이 태스크와 하위 분야의 관련 논문입니다. 실제 성능 비교는 평가 결과에서 확인하세요.
Learning Video Context as Interleaved Multimodal Sequences
Effectively Leveraging CLIP for Generating Situational Summaries of Images and Videos
Wolf: Captioning Everything with a World Summarization Framework
Reexamining Racial Disparities in Automatic Speech Recognition Performance: The Role of Confounding by Provenance
EVLM: An Efficient Vision-Language Model for Visual Understanding
https://arxiv.org/abs/2407.00634
Directed Domain Fine-Tuning: Tailoring Separate Modalities for Specific Training Tasks
Live Video Captioning
GUI Action Narrator: Where and When Did That Action Take Place?
AlanaVLM: A Multimodal Embodied AI Foundation Model for Egocentric Video Understanding
Towards Holistic Language-video Representation: the language model-enhanced MSR-Video to Text Dataset
A Survey of Video Datasets for Grounded Event Understanding
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
Vript: A Video Is Worth Thousands of Words
NarrativeBridge: Enhancing Video Captioning with Causal-Temporal Narrative
ShareGPT4Video: Improving Video Understanding and Generation with Better Captions
Story Generation from Visual Inputs: Techniques, Related Tasks, and Challenges
Shotluck Holmes: A Family of Efficient Small-Scale Large Language Vision Models For Video Captioning and Summarization
VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding
RETTA: Retrieval-Enhanced Test-Time Adaptation for Zero-Shot Video Captioning
A Toolchain for Comprehensive Audio/Video Analysis Using Deep Learning Based Multimodal Approach (A use case of riot or violent context detection)
Narrative Action Evaluation with Prompt-Guided Multimodal Interaction
Movie101v2: Improved Movie Narration Benchmark
The 8th AI City Challenge
TrafficVLM: A Controllable Visual Language Model for Traffic Video Captioning
Enhancing Traffic Safety with Parallel Dense Video Captioning for End-to-End Event Analysis
Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
DIBS: Enhancing Dense Video Captioning with Unlabeled Videos via Pseudo Boundary Enrichment and Online Refinement
Streaming Dense Video Captioning
OmniVid: A Generative Framework for Universal Video Understanding
Empowering LLMs with Pseudo-Untrimmed Videos for Audio-Visual Temporal Understanding
GiT: Towards Generalist Vision Transformer through Universal Language Interface
Sora as an AGI World Model? A Complete Survey on Text-to-Video Generation
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.