← Visual Reasoning
Papers with Code · CC BY-SA 4.0

Winoground

아카이브 평가 114건 · 마지막 적재/변경

평가 기록

과거 수집 기록이며 최신 순위가 아닙니다. 데이터셋 버전·split·실험 조건과 지표 방향이 검증되지 않은 결과는 직접 비교할 수 없습니다. 날짜는 논문 날짜이며 최신 평가일을 뜻하지 않습니다.

표가 화면보다 넓으면 좌우로 스크롤하여 논문과 구현 링크를 확인하세요.

원본 기록 순서 · 순위 미부여
모델원본 지표·값논문구현
MiniGPT-4
Text Score
23.3
Image Score
18.0
Group Score
9.5
Incorporating Structured Representations into Pretrained Vision & Language Models Using Scene Graphs
2023-05-10
연결 없음
MiniGPT-4-7B (VisualGPTScore)
Text Score
23.25
Image Score
18.00
Group Score
9.50
An Examination of the Compositionality of Large Generative Vision-Language Models
2023-08-21
코드 1
VSE++ (COCO, ResNet)
Text Score
22.75
Image Score
8.00
Group Score
4.00
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022-04-07
코드 1 · 코드 2
OFA tiny (ITM)
Text Score
22.75
Image Score
7.75
Group Score
4.50
Simple Token-Level Confidence Improves Caption Correctness
2023-05-11
연결 없음
LDM-CLIP (SelfEval)
Text Score
22.75
Image Score
7.25
SelfEval: Leveraging the discriminative nature of generative models for evaluation
2023-11-17
연결 없음
Gemini + CCoT
Text Score
22.5
Image Score
33
Group Score
20.75
CoCoT: Contrastive Chain-of-Thought Prompting for Large Multimodal Models with Multiple Image Inputs
2024-01-05
코드 1
InstructBLIP-CCoT
Text Score
21.0
Image Score
21.3
Group Score
8.3
Compositional Chain-of-Thought Prompting for Large Multimodal Models
2023-11-27
코드 1
VSRN (Flickr30k)
Text Score
20.00
Image Score
5.00
Group Score
3.50
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022-04-07
코드 1 · 코드 2
VSE++ (Flickr30k, ResNet)
Text Score
20.00
Image Score
5.00
Group Score
2.75
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022-04-07
코드 1 · 코드 2
VSE++ (Flickr30k, VGG)
Text Score
19.75
Image Score
6.25
Group Score
4.50
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022-04-07
코드 1 · 코드 2
UniT (ITM finetuned)
Text Score
19.50
Image Score
6.25
Group Score
4.00
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022-04-07
코드 1 · 코드 2
LXMERT
Text Score
19.25
Image Score
7.00
Group Score
4.00
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022-04-07
코드 1 · 코드 2
TIFA
Text Score
19.00
Image Score
12.50
Group Score
11.30
What You See is What You Read? Improving Text-Image Alignment Evaluation
2023-05-17
코드 1
IDEFICS 80B
Text Score
18.75
Image Score
22.5
Group Score
8.0
연결 없음
논문 날짜 미기재
연결 없음
VSE++ (COCO, VGG)
Text Score
18.75
Image Score
5.50
Group Score
3.50
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022-04-07
코드 1 · 코드 2
VSRN (COCO)
Text Score
17.50
Image Score
7.00
Group Score
3.75
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022-04-07
코드 1 · 코드 2
PDM-CLIP (SelfEval)
Text Score
17.00
Image Score
14.00
SelfEval: Leveraging the discriminative nature of generative models for evaluation
2023-11-17
연결 없음
IDEFICS 9B
Text Score
16.8
Image Score
20.8
Group Score
5.0
연결 없음
논문 날짜 미기재
연결 없음
OFA tiny (TLC-A)
Text Score
16.50
Image Score
15.75
Group Score
6.75
Simple Token-Level Confidence Improves Caption Correctness
2023-05-11
연결 없음
VisualBERT base
Text Score
15.50
Image Score
2.50
Group Score
1.50
Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality
2022-04-07
코드 1 · 코드 2
MiniGPT-4-7B (BERTScore)
Text Score
14.00
Image Score
8.00
Group Score
2.75
An Examination of the Compositionality of Large Generative Vision-Language Models
2023-08-21
코드 1
LLaVA-7B (BERTScore)
Text Score
13.50
Image Score
5.25
Group Score
2.25
An Examination of the Compositionality of Large Generative Vision-Language Models
2023-08-21
코드 1
InstructBLIP-ZS-CoT
Text Score
9.3
Image Score
16.3
Group Score
4.0
Compositional Chain-of-Thought Prompting for Large Multimodal Models
2023-11-27
코드 1
InstructBLIP
Text Score
7.0
Image Score
11.5
Group Score
3.3
Compositional Chain-of-Thought Prompting for Large Multimodal Models
2023-11-27
코드 1