Papers with Code 아카이브

Video Question Answering

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법전체 데이터셋

하위 태스크

2

평가표

28

보존된 평가 기록

254

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/md-mohaiminul/BIMBA

공식 코드

BIMBA: Selective-Scan Compression for Long-Range Video Question Answering

https://github.com/md-mohaiminul/VideoRecap

공식 코드

Video ReCap: Recursive Captioning of Hour-Long Videos

https://github.com/microsoft/lavender

공식 코드

LAVENDER: Unifying Video-Language Understanding as Masked Language Modeling

https://github.com/microsoft/swinbert

공식 코드

SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning

https://github.com/microsoft/xpretrain

공식 코드

Long-Form Video-Language Pre-Training with Multimodal Temporal Contrastive Learning

https://github.com/mikewangwzhl/paxion

공식 코드

Paxion: Patching Action Knowledge in Video-Language Foundation Models

https://github.com/mikewangwzhl/vidil

공식 코드

Language Models with Image Descriptors are Strong Few-Shot Video-Language Learners

https://github.com/mistralai/mistral-src

공식 코드

Mistral 7B

https://github.com/mit-han-lab/llm-awq

공식 코드

VILA: On Pre-training for Visual Language Models

https://github.com/mlvlab/Flipped-VQA

공식 코드

Large Language Models are Temporal and Causal Reasoners for Video Question Answering

https://github.com/mlvlab/MELTR

공식 코드

MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models

https://github.com/mlvlab/ovqa

공식 코드

Open-vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Models

https://github.com/mlvlab/vid-tldr

공식 코드

vid-TLDR: Training Free Token merging for Light-weight Video Transformer

https://github.com/mu-cai/TemporalBench

공식 코드

TemporalBench: Benchmarking Fine-grained Temporal Understanding for Multimodal Video Models

https://github.com/nercms-mmap/friendsqa

공식 코드

FriendsQA: A New Large-Scale Deep Video Understanding Dataset with Fine-grained Topic Categorization for Story Videos

https://github.com/nguyentthong/MAMA

공식 코드

MAMA: Meta-optimized Angular Margin Contrastive Framework for Video-Language Representation Learning

https://github.com/noagarcia/ROLL-VideoQA

공식 코드

Knowledge-Based Video Question Answering with Unsupervised Scene Descriptions

https://github.com/nvlabs/lita

공식 코드

LITA: Language Instructed Temporal-Localization Assistant

https://github.com/nvlabs/vila

공식 코드

VILA: On Pre-training for Visual Language Models

https://github.com/opengvlab/ask-anything

공식 코드

VideoChat: Chat-Centric Video Understanding

https://github.com/opengvlab/internvideo

공식 코드

InternVideo: General Video Foundation Models via Generative and Discriminative Learning

https://github.com/opengvlab/internvideo2

공식 코드

InternVideo2: Scaling Foundation Models for Multimodal Video Understanding

https://github.com/opengvlab/internvl

공식 코드

Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scaling

https://github.com/opengvlab/unmasked_teacher

공식 코드

Unmasked Teacher: Towards Training-Efficient Video Foundation Models

https://github.com/openmicg/mcg

공식 코드

Multi-granularity Contrastive Cross-modal Collaborative Generation for End-to-End Long-term Video Question Answering

https://github.com/oryx-mllm/oryx

공식 코드

Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolution

https://github.com/panasonicconnect/videomultiagents

공식 코드

VideoMultiAgents: A Multi-Agent Framework for Video Question Answering

https://github.com/pku-yuangroup/chat-univi

공식 코드

Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding

https://github.com/pluslabnlp/acquired

공식 코드

ACQUIRED: A Dataset for Answering Counterfactual Questions In Real-Life Videos

https://github.com/qhuni/deve-qa

공식 코드

Question-Answering Dense Video Events

https://github.com/qwenlm/qwen2-vl

공식 코드

Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution

https://github.com/renmengye/imageqa-public

공식 코드

Exploring Models and Data for Image Question Answering

https://github.com/renshuhuai-andy/testa

공식 코드

TESTA: Temporal-Spatial Token Aggregation for Long-form Video-Language Understanding

https://github.com/renshuhuai-andy/timechat

공식 코드

TimeChat: A Time-sensitive Multimodal Large Language Model for Long Video Understanding

https://github.com/rese1f/MovieChat

공식 코드

MovieChat: From Dense Token to Sparse Memory for Long Video Understanding

https://github.com/rh-dang/ecbench

공식 코드

ECBench: Can Multi-modal Foundation Models Understand the Egocentric World? A Holistic Embodied Cognition Benchmark

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.