| InfiMM-HD |
- GPT-4 score
- 38.9
|
InfiMM-HD: A Leap Forward in High-Resolution Multimodal Understanding 2024-03-03 |
연결 없음 |
| InternLM-XC2 + MMDU-45k |
- GPT-4 score
- 38.8
|
MMDU: A Multi-Turn Multi-Image Dialog Understanding Benchmark and Instruction-Tuning Dataset for LVLMs 2024-06-17 |
코드 1 |
| LLaVA-1.5-7B (DC-S) |
- GPT-4 score
- 38.5
|
ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models 2024-12-09 |
코드 1 |
| LayoutLMv3+ConvNeXt+CLIP |
- GPT-4 score
- 38.4
- Params
- 7.9B
|
MouSi: Poly-Visual-Expert Vision-Language Models 2024-01-30 |
코드 1 |
| VOLCANO 13B |
- GPT-4 score
- 38.0
- Params
- 13B
|
Volcano: Mitigating Multimodal Hallucination through Self-Feedback Guided Revision 2023-11-13 |
코드 1 |
| LLaVA-1.5+MMInstruct (Vicuna-13B) |
- GPT-4 score
- 37.9
|
MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversity 2024-07-22 |
코드 1 |
| LLaVA-1.5-13B (+CSR) |
- GPT-4 score
- 37.8
- Params
- 13B
|
Calibrated Self-Rewarding Vision Language Models 2024-05-23 |
코드 1 |
| LLaVA-1.5-LLaMA3-8B |
- GPT-4 score
- 37.8
|
What If We Recaption Billions of Web Images with LLaMA-3? 2024-06-12 |
연결 없음 |
| LLaVA-1.5 + DenseFusion-1M (Vicuna-7B) |
- GPT-4 score
- 37.8
|
DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception 2024-07-11 |
코드 1 |
| ShareGPT4V-7B |
- GPT-4 score
- 37.6
- Params
- 7B
|
ShareGPT4V: Improving Large Multi-Modal Models with Better Captions 2023-11-21 |
코드 1 |
| LLaVA-1.5+CoS |
- GPT-4 score
- 37.6
|
Chain-of-Spot: Interactive Reasoning Improves Large Vision-Language Models 2024-03-19 |
코드 1 |
| LLaVA-COCO-13B |
- GPT-4 score
- 37.5
|
COCO is "ALL'' You Need for Visual Instruction Fine-tuning 2024-01-17 |
연결 없음 |
| LLaVA-S^2 + DenseFusion-1M (Vicuna-7B) |
- GPT-4 score
- 37.5
|
DenseFusion-1M: Merging Vision Experts for Comprehensive Multimodal Perception 2024-07-11 |
코드 1 |
| MM1.5-1B |
- GPT-4 score
- 37.4
|
MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuning 2024-09-30 |
연결 없음 |
| Dynamic-LLaVA-13B |
- GPT-4 score
- 37.3
|
Dynamic-LLaVA: Efficient Multimodal Large Language Models via Dynamic Vision-language Context Sparsification 2024-12-01 |
코드 1 |
| SeVa-7B |
- GPT-4 score
- 37.2
|
Self-Supervised Visual Preference Alignment 2024-04-16 |
코드 1 |
| SoM-LLaVA-1.5-T |
- GPT-4 score
- 37.2
|
List Items One by One: A New Data Source and Learning Paradigm for Multimodal LLMs 2024-04-25 |
코드 1 |
| Emu3 |
- GPT-4 score
- 37.2
|
Emu3: Next-Token Prediction is All You Need 2024-09-27 |
코드 1 · 코드 2 |
| LLaVA-Instruct (Vicuna-1.5-13B) |
- GPT-4 score
- 37.1
|
MM-Instruct: Generated Visual Instructions for Large Multimodal Model Alignment 2024-06-28 |
코드 1 · 코드 2 |
| ILLUME |
- GPT-4 score
- 37.0
|
ILLUME: Illuminating Your LLMs to See, Draw, and Self-Enhance 2024-12-09 |
연결 없음 |
| LLaVA1.5-7B-BPO |
- GPT-4 score
- 36.8
- Params
- 7B
|
Strengthening Multimodal Large Language Model with Bootstrapped Preference Optimization 2024-03-13 |
연결 없음 |
| LLaVA-1.5-13B (+ MMFuser) |
- GPT-4 score
- 36.6
|
MMFuser: Multimodal Multi-Layer Feature Fuser for Fine-Grained Vision-Language Understanding 2024-10-15 |
코드 1 |
| CaMML-13B |
- GPT-4 score
- 36.4
|
CaMML: Context-Aware Multimodal Learner for Large Models 2024-01-06 |
코드 1 |
| LLaVA-65B (Data Mixing) |
- GPT-4 score
- 36.4
|
An Empirical Study of Scaling Instruct-Tuned Large Multimodal Models 2023-09-18 |
코드 1 |
| LLaVA-1.5-13B |
- GPT-4 score
- 36.3±0.2
- Params
- 13B
|
Improved Baselines with Visual Instruction Tuning 2023-10-05 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8 · 코드 9 |
| Emu-14B |
- GPT-4 score
- 36.3±0.3
- Params
- 14B
|
Emu: Generative Pretraining in Multimodality 2023-07-11 |
코드 1 · 코드 2 |
| mPLUG-Owl2 |
- GPT-4 score
- 36.3±0.1
- Params
- 7B
|
mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration 2023-11-07 |
코드 1 · 코드 2 |
| Vary-base |
- GPT-4 score
- 36.2
|
Vary: Scaling up the Vision Vocabulary for Large Vision-Language Models 2023-12-11 |
코드 1 |
| StableLLaVA |
- GPT-4 score
- 36.1
|
StableLLaVA: Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data 2023-08-20 |
코드 1 |
| DreamLLM-7B |
- GPT-4 score
- 35.9
- Params
- 7B
|
DreamLLM: Synergistic Multimodal Comprehension and Creation 2023-09-20 |
코드 1 |