← Video-based Generative Performance Benchmarking
Papers with Code · CC BY-SA 4.0

VideoInstruct

아카이브 평가 23건 · 마지막 적재/변경

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델원본 지표·값논문구현
PPLLaVA-7B-dpo
Correctness of Information
3.85
Detail Orientation
3.56
Contextual Understanding
4.21
Temporal Understanding
3.21
Consistency
3.81
mean
3.73
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance
2024-11-04
코드 1
VLM-RLAIF
Correctness of Information
3.63
Detail Orientation
3.25
Contextual Understanding
4
Temporal Understanding
3.23
Consistency
3.32
mean
3.49
Tuning Large Multimodal Models for Videos using Reinforcement Learning from AI Feedback
2024-02-06
코드 1
TS-LLaVA-34B
mean
3.38
TS-LLaVA: Constructing Visual Tokens through Thumbnail-and-Sampling for Training-Free Video Large Language Models
2024-11-17
코드 1
PLLaVA-34B
Correctness of Information
3.60
Detail Orientation
3.20
Contextual Understanding
3.90
Temporal Understanding
2.67
Consistency
3.25
mean
3.32
PLLaVA : Parameter-free LLaVA Extension from Images to Videos for Video Dense Captioning
2024-04-25
코드 1
PPLLaVA-7B
Correctness of Information
3.32
Detail Orientation
3.20
Contextual Understanding
3.88
Temporal Understanding
3.0
Consistency
3.20
mean
3.32
PPLLaVA: Varied Video Sequence Understanding With Prompt Guidance
2024-11-04
코드 1
SlowFast-LLaVA-34B
mean
3.32
SlowFast-LLaVA: A Strong Training-Free Baseline for Video Large Language Models
2024-07-22
코드 1
VideoGPT+
Correctness of Information
3.27
Detail Orientation
3.18
Contextual Understanding
3.74
Temporal Understanding
2.83
Consistency
3.39
mean
3.28
VideoGPT+: Integrating Image and Video Encoders for Enhanced Video Understanding
2024-06-13
코드 1
IG-VLM-GPT4v
Correctness of Information
3.40
Detail Orientation
2.80
Contextual Understanding
3.61
Temporal Understanding
2.89
Consistency
3.13
mean
3.17
An Image Grid Can Be Worth a Video: Zero-shot Video Question Answering Using a VLM
2024-03-27
코드 1
ST-LLM-7B
Correctness of Information
3.23
Detail Orientation
3.05
Contextual Understanding
3.74
Temporal Understanding
2.93
Consistency
2.81
mean
3.15
ST-LLM: Large Language Models Are Effective Temporal Learners
2024-03-30
코드 1
VideoChat2_HD_mistral
Correctness of Information
3.40
Detail Orientation
2.91
Contextual Understanding
3.72
Temporal Understanding
2.65
Consistency
2.84
mean
3.10
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark
2023-11-28
코드 1 · 코드 2 · 코드 3
CAT-7B
Correctness of Information
3.08
Detail Orientation
2.95
Contextual Understanding
3.49
Temporal Understanding
2.81
Consistency
2.89
mean
3.07
CAT: Enhancing Multimodal Large Language Model to Answer Questions in Dynamic Audio-Visual Scenarios
2024-03-07
코드 1
LITA-13B
Correctness of Information
2.94
Detail Orientation
2.98
Contextual Understanding
3.43
Temporal Understanding
2.68
Consistency
3.19
mean
3.04
LITA: Language Instructed Temporal-Localization Assistant
2024-03-27
코드 1
LLaMA-VID-13B (2 Token)
Correctness of Information
3.07
Detail Orientation
3.05
Contextual Understanding
3.60
Temporal Understanding
2.58
Consistency
2.63
mean
2.99
LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models
2023-11-28
코드 1 · 코드 2
Chat-UniVi
Correctness of Information
2.89
Detail Orientation
2.91
Contextual Understanding
3.46
Temporal Understanding
2.39
Consistency
2.81
mean
2.99
Chat-UniVi: Unified Visual Representation Empowers Large Language Models with Image and Video Understanding
2023-11-14
코드 1 · 코드 2 · 코드 3 · 코드 4
VideoChat2
Correctness of Information
3.02
Detail Orientation
2.88
Contextual Understanding
3.51
Temporal Understanding
2.66
Consistency
2.81
mean
2.98
MVBench: A Comprehensive Multi-modal Video Understanding Benchmark
2023-11-28
코드 1 · 코드 2 · 코드 3
LLaMA-VID-7B (2 Token)
Correctness of Information
2.96
Detail Orientation
3.00
Contextual Understanding
3.53
Temporal Understanding
2.46
Consistency
2.51
mean
2.89
LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models
2023-11-28
코드 1 · 코드 2
VTimeLLM
Correctness of Information
2.78
Detail Orientation
3.10
Contextual Understanding
3.40
Temporal Understanding
2.49
Consistency
2.47
mean
2.85
VTimeLLM: Empower LLM to Grasp Video Moments
2023-11-30
코드 1
BT-Adapter
Correctness of Information
2.68
Detail Orientation
2.69
Contextual Understanding
3.27
Temporal Understanding
2.34
Consistency
2.46
mean
2.69
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
2023-09-27
코드 1
BT-Adapter (zero-shot)
Correctness of Information
2.16
Detail Orientation
2.46
Contextual Understanding
2.89
Temporal Understanding
2.13
Consistency
2.2
mean
2.46
BT-Adapter: Video Conversation is Feasible Without Video Instruction Tuning
2023-09-27
코드 1
Video-ChatGPT
Correctness of Information
2.4
Detail Orientation
2.52
Contextual Understanding
2.62
Temporal Understanding
1.98
Consistency
2.37
mean
2.38
Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language Models
2023-06-08
코드 1 · 코드 2
Video Chat
Correctness of Information
2.23
Detail Orientation
2.50
Contextual Understanding
2.53
Temporal Understanding
1.94
Consistency
2.24
mean
2.29
VideoChat: Chat-Centric Video Understanding
2023-05-10
코드 1
LLaMA Adapter
Correctness of Information
2.03
Detail Orientation
2.32
Contextual Understanding
2.30
Temporal Understanding
1.98
Consistency
2.15
mean
2.16
LLaMA-Adapter V2: Parameter-Efficient Visual Instruction Model
2023-04-28
코드 1 · 코드 2 · 코드 3
Video LLaMA
Correctness of Information
1.96
Detail Orientation
2.18
Contextual Understanding
2.16
Temporal Understanding
1.82
Consistency
1.79
mean
1.98
Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
2023-06-05
코드 1 · 코드 2 · 코드 3 · 코드 4