| OneLLM-7B |
- GPT-4 score
- 29.1
- Params
- 7B
|
OneLLM: One Framework to Align All Modalities with Language 2023-12-06 |
코드 1 |
| LLaVA-OneVision-0.5B |
- GPT-4 score
- 29.1
|
LLaVA-OneVision: Easy Visual Task Transfer 2024-08-06 |
코드 1 · 코드 2 |
| Vary-toy |
- GPT-4 score
- 29.0
- Params
- 1.8B
|
Small Language Model Meets with Reinforced Vision Vocabulary 2024-01-23 |
연결 없음 |
| LLaVA-Phi |
- GPT-4 score
- 28.9
|
LLaVA-Phi: Efficient Multi-Modal Assistant with Small Language Model 2024-01-04 |
코드 1 |
| MM-ReAct-GPT-3.5 |
- GPT-4 score
- 27.9±0.1
|
MM-REACT: Prompting ChatGPT for Multimodal Reasoning and Action 2023-03-20 |
코드 1 |
| MMAR-7B |
- GPT-4 score
- 27.80
|
MMAR: Towards Lossless Multi-Modal Auto-Regressive Probabilistic Modeling 2024-10-14 |
연결 없음 |
| SEAL (7B) |
- GPT-4 score
- 27.7
- Params
- 7B
|
V*: Guided Visual Search as a Core Mechanism in Multimodal LLMs 2023-12-21 |
코드 1 |
| LLaVA-Plus-7B (All Tools) |
- GPT-4 score
- 27.5±0.3
- Params
- 7B
|
LLaVA-Plus: Learning to Use Tools for Creating Multimodal Agents 2023-11-09 |
코드 1 |
| OtterHD-8B |
- GPT-4 score
- 26.3
- Params
- 8B
|
OtterHD: A High-Resolution Multi-modality Model 2023-11-07 |
코드 1 |
| TGA-7B |
- GPT-4 score
- 25.6
|
Cross-Modal Safety Mechanism Transfer in Large Vision-Language Models 2024-10-16 |
연결 없음 |
| OpenFlamingo-9B (MPT-7B) |
- GPT-4 score
- 24.8±0.2
- Params
- 9B
|
OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models 2023-08-02 |
코드 1 · 코드 2 |
| Otter-9B (MPT-7B) |
- GPT-4 score
- 24.7±0.3
- Params
- 9B
|
MIMIC-IT: Multi-Modal In-Context Instruction Tuning 2023-06-08 |
코드 1 · 코드 2 |
| Otter-9B (LLaMA) |
- GPT-4 score
- 24.6±0.2
- Params
- 9B
|
MIMIC-IT: Multi-Modal In-Context Instruction Tuning 2023-06-08 |
코드 1 · 코드 2 |
| MiniGPT-4-14B |
- GPT-4 score
- 24.4±0.4
- Params
- 14B
|
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models 2023-04-20 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 |
| LinVT |
- GPT-4 score
- 23.5
|
LinVT: Empower Your Image-level Large Language Model to Understand Videos 2024-12-06 |
코드 1 |
| BLIP-2-12B |
- GPT-4 score
- 22.4±0.2
- Params
- 12B
|
BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Models 2023-01-30 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 · 코드 7 · 코드 8 · 코드 9 · 코드 10 · 코드 11 · 코드 12 · 코드 13 · 코드 14 · 코드 15 · 코드 16 · 코드 17 |
| MiniGPT-4-8B |
- GPT-4 score
- 22.1±0.1
- Params
- 8B
|
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models 2023-04-20 |
코드 1 · 코드 2 · 코드 3 · 코드 4 · 코드 5 · 코드 6 |
| OpenFlamingo-9B (LLaMA-7B) |
- GPT-4 score
- 21.8±0.1
- Params
- 9B
|
OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Models 2023-08-02 |
코드 1 · 코드 2 |
| Xmodel-VLM (Xmodel-LM 1.1B) |
- GPT-4 score
- 21.8
|
Xmodel-VLM: A Simple Baseline for Multimodal Vision Language Model 2024-05-15 |
코드 1 · 코드 2 · 코드 3 · 코드 4 |
| TextBind |
- GPT-4 score
- 19.4
|
TextBind: Multi-turn Interleaved Multimodal Instruction-following in the Wild 2023-09-14 |
코드 1 |
| MMAR-0.5B |
- GPT-4 score
- 18.49
|
MMAR: Towards Lossless Multi-Modal Auto-Regressive Probabilistic Modeling 2024-10-14 |
연결 없음 |