Survey: Transformer based Video-Language Pre-training
원문 초록
Inspired by the success of transformer-based pre-training methods on natural language tasks and further computer vision tasks, researchers have begun to apply transformer to video processing. This survey aims to give a comprehensive overview on transformer-based pre-training methods for Video-Language learning. We first briefly introduce the transformer tructure as the background knowledge, including attention mechanism, position encoding etc. We then describe the typical paradigm of pre-training & fine-tuning on Video-Language processing in terms of proxy tasks, downstream tasks and commonly used video datasets. Next, we categorize transformer models into Single-Stream and Multi-Stream structures, highlight their innovations and compare their performances. Finally, we analyze and discuss the current challenges and possible future research directions for Video-Language pre-training.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Car Object Counting and Position Estimation via Extension of the CLIP-EBC Framework
A Survey on Prompt Tuning
A Survey on Latent Reasoning
A Survey on Vision-Language-Action Models for Autonomous Driving
From Tiny Machine Learning to Tiny Deep Learning: A Survey
A Comprehensive Survey on Continual Learning in Generative Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.