https://github.com/wangjk666/omnivid
공식 코드OmniVid: A Generative Framework for Universal Video Understanding
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
OmniVid: A Generative Framework for Universal Video Understanding
mPLUG-Owl: Modularization Empowers Large Language Models with Multimodality
ViLA: Efficient Video-Language Alignment for Video Question Answering
Tem-adapter: Adapting Image-Text Pretraining for Video Question Answer
Towards Fast Adaptation of Pretrained Contrastive Models for Multi-channel Video-Language Retrieval
A Better Way to Attend: Attention with Trees for Video Question Answering
STAIR: Spatial-Temporal Reasoning with Auditable Intermediate Results for Video Question Answering
HawkEye: Training Video-Text LLMs for Grounding Text in Videos
Equivariant and Invariant Grounding for Video Question Answering
Discovering Spatio-Temporal Rationales for Video Question Answering
Self-Chained Image-Language Model for Video Localization and Question Answering
Temporally-Grounded Language Generation: A Benchmark for Real-Time Vision-Language Models
Visual Commonsense-aware Representation Network for Video Captioning
X$^2$-VLM: All-In-One Pre-trained Model For Vision-Language Tasks
Encoding and Controlling Global Semantics for Long-form Video Question Answering
EgoTextVQA: Towards Egocentric Scene-Text Aware Video Question Answering
Scene-Text Grounding for Text-Based Video Question Answering
LongVLM: Efficient Long Video Understanding via Large Language Models
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
Relation-aware Hierarchical Attention Framework for Video Question Answering
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.