https://github.com/antoyang/FrozenBiLM
공식 코드Zero-Shot Video Question Answering via Frozen Bidirectional Language Models
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Zero-Shot Video Question Answering via Frozen Bidirectional Language Models
Just Ask: Learning to Answer Questions from Millions of Narrated Videos
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models
Learning Situation Hyper-Graphs for Video Question Answering
Streaming Video Question-Answering with In-context Video KV-Cache Retrieval
Efficient Temporal Extrapolation of Multimodal Large Language Models with Temporal Grounding Bridge
Efficient Temporal Extrapolation of Multimodal Large Language Models with Temporal Grounding Bridge
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding
Fine-grained Audio-Visual Joint Representations for Multimodal Large Language Models
Shot2Story20K: A New Benchmark for Comprehensive Understanding of Multi-shot Videos
video-SALMONN 2: Captioning-Enhanced Audio-Visual Large Language Models
Glance and Focus: Memory Prompting for Multi-Event Video Question Answering
Empowering Large Language Model for Continual Video Question Answering with Collaborative Prompting
A Simple LLM Framework for Long-Range Video Question-Answering
Vision-Language Pre-training: Basics, Recent Advances, and Future Trends
Free Video-LLM: Prompt-guided Visual Perception for Efficient Training-free Video LLMs
Revitalize Region Feature for Democratizing Video-Language Pre-training of Retrieval
ViperGPT: Visual Inference via Python Execution for Reasoning
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
VideoLLaMA 3: Frontier Multimodal Foundation Models for Image and Video Understanding
Question-Instructed Visual Descriptions for Zero-Shot Video Question Answering
Self-Adaptive Sampling for Efficient Video Question-Answering on Image--Text Models
Self-Adaptive Sampling for Efficient Video Question-Answering on Image--Text Models
Perception Test: A Diagnostic Benchmark for Multimodal Video Models
NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actions
Contrastive Video Question Answering via Video Graph Transformer
Video as Conditional Graph Hierarchy for Multi-Granular Question Answering
Can I Trust Your Answer? Visually Grounded Video Question Answering
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.