← Long-Context Understanding
Papers with Code · CC BY-SA 4.0

MMNeedle

아카이브 평가 12건 · 마지막 적재/변경

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델원본 지표·값논문구현
GPT-4o
1 Image, 2*2 Stitching, Exact Accuracy
94.6
1 Image, 4*4 Stitching, Exact Accuracy
83
1 Image, 8*8 Stitching, Exact Accuracy
19
10 Images, 1*1 Stitching, Exact Accuracy
97
10 Images, 2*2 Stitching, Exact Accuracy
81.8
10 Images, 4*4 Stitching, Exact Accuracy
26.9
10 Images, 8*8 Stitching, Exact Accuracy
1
GPT-4 Technical Report
2023-03-15
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8 · 코드 9 · 코드 10 · 코드 11
GPT-4V
1 Image, 2*2 Stitching, Exact Accuracy
86.09
1 Image, 4*4 Stitching, Exact Accuracy
54.72
1 Image, 8*8 Stitching, Exact Accuracy
7.3
10 Images, 1*1 Stitching, Exact Accuracy
72.36
10 Images, 2*2 Stitching, Exact Accuracy
34.24
10 Images, 4*4 Stitching, Exact Accuracy
7.58
10 Images, 8*8 Stitching, Exact Accuracy
0
GPT-4 Technical Report
2023-03-15
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8 · 코드 9 · 코드 10 · 코드 11
Gemini Pro 1.5
1 Image, 2*2 Stitching, Exact Accuracy
90.34
1 Image, 4*4 Stitching, Exact Accuracy
39.85
1 Image, 8*8 Stitching, Exact Accuracy
29.81
10 Images, 1*1 Stitching, Exact Accuracy
89.94
10 Images, 2*2 Stitching, Exact Accuracy
45.21
10 Images, 4*4 Stitching, Exact Accuracy
6.09
10 Images, 8*8 Stitching, Exact Accuracy
0.62
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context
2024-03-08
코드 1
Gemini Pro 1.0
1 Image, 2*2 Stitching, Exact Accuracy
29.53
1 Image, 4*4 Stitching, Exact Accuracy
24.78
1 Image, 8*8 Stitching, Exact Accuracy
2.11
10 Images, 1*1 Stitching, Exact Accuracy
16.25
10 Images, 2*2 Stitching, Exact Accuracy
4.82
10 Images, 4*4 Stitching, Exact Accuracy
0.4
10 Images, 8*8 Stitching, Exact Accuracy
0
Gemini: A Family of Highly Capable Multimodal Models
2023-12-19
코드 1
LLaVA-Llama-3
1 Image, 2*2 Stitching, Exact Accuracy
43.8
1 Image, 4*4 Stitching, Exact Accuracy
17.5
1 Image, 8*8 Stitching, Exact Accuracy
3.3
10 Images, 1*1 Stitching, Exact Accuracy
0
10 Images, 2*2 Stitching, Exact Accuracy
0
10 Images, 4*4 Stitching, Exact Accuracy
0
10 Images, 8*8 Stitching, Exact Accuracy
0
LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images
2024-03-18
코드 1
Claude 3 Opus
1 Image, 2*2 Stitching, Exact Accuracy
52.25
1 Image, 4*4 Stitching, Exact Accuracy
12.3
1 Image, 8*8 Stitching, Exact Accuracy
1.6
10 Images, 1*1 Stitching, Exact Accuracy
66.93
10 Images, 2*2 Stitching, Exact Accuracy
4.6
10 Images, 4*4 Stitching, Exact Accuracy
0.4
10 Images, 8*8 Stitching, Exact Accuracy
0
The Claude 3 Model Family: Opus, Sonnet, Haiku
2024-03-04
연결 없음
IDEFICS2-8B
1 Image, 2*2 Stitching, Exact Accuracy
18.9
1 Image, 4*4 Stitching, Exact Accuracy
7.8
1 Image, 8*8 Stitching, Exact Accuracy
0.9
10 Images, 1*1 Stitching, Exact Accuracy
0
10 Images, 2*2 Stitching, Exact Accuracy
0
10 Images, 4*4 Stitching, Exact Accuracy
0
10 Images, 8*8 Stitching, Exact Accuracy
0
What matters when building vision-language models?
2024-05-03
연결 없음
InstructBLIP-Flan-T5-XXL
1 Image, 2*2 Stitching, Exact Accuracy
3.8
1 Image, 4*4 Stitching, Exact Accuracy
6.2
1 Image, 8*8 Stitching, Exact Accuracy
2.2
10 Images, 1*1 Stitching, Exact Accuracy
0
10 Images, 2*2 Stitching, Exact Accuracy
0
10 Images, 4*4 Stitching, Exact Accuracy
0
10 Images, 8*8 Stitching, Exact Accuracy
0
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
2023-05-11
코드 1 · 코드 2 · 코드 3 · 코드 4
CogVLM2-Llama-3
1 Image, 2*2 Stitching, Exact Accuracy
7.3
1 Image, 4*4 Stitching, Exact Accuracy
0.9
1 Image, 8*8 Stitching, Exact Accuracy
0.1
10 Images, 1*1 Stitching, Exact Accuracy
0
10 Images, 2*2 Stitching, Exact Accuracy
0
10 Images, 4*4 Stitching, Exact Accuracy
0
10 Images, 8*8 Stitching, Exact Accuracy
0
CogVLM: Visual Expert for Pretrained Language Models
2023-11-06
코드 1 · 코드 2 · 코드 3 · 코드 4
mPLUG-Owl-v2
1 Image, 2*2 Stitching, Exact Accuracy
1.9
1 Image, 4*4 Stitching, Exact Accuracy
0.3
1 Image, 8*8 Stitching, Exact Accuracy
0.7
10 Images, 1*1 Stitching, Exact Accuracy
0.4
10 Images, 2*2 Stitching, Exact Accuracy
0.1
10 Images, 4*4 Stitching, Exact Accuracy
0
10 Images, 8*8 Stitching, Exact Accuracy
0
mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration
2023-11-07
코드 1 · 코드 2
CogVLM-17B
1 Image, 2*2 Stitching, Exact Accuracy
0
1 Image, 4*4 Stitching, Exact Accuracy
0.1
1 Image, 8*8 Stitching, Exact Accuracy
0.3
10 Images, 1*1 Stitching, Exact Accuracy
0
10 Images, 2*2 Stitching, Exact Accuracy
0
10 Images, 4*4 Stitching, Exact Accuracy
0
10 Images, 8*8 Stitching, Exact Accuracy
0
CogVLM: Visual Expert for Pretrained Language Models
2023-11-06
코드 1 · 코드 2 · 코드 3 · 코드 4
InstructBLIP-Vicuna-13B
1 Image, 2*2 Stitching, Exact Accuracy
0
1 Image, 4*4 Stitching, Exact Accuracy
0
1 Image, 8*8 Stitching, Exact Accuracy
0
10 Images, 1*1 Stitching, Exact Accuracy
0
10 Images, 2*2 Stitching, Exact Accuracy
0
10 Images, 4*4 Stitching, Exact Accuracy
0
10 Images, 8*8 Stitching, Exact Accuracy
0
InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuning
2023-05-11
코드 1 · 코드 2 · 코드 3 · 코드 4