https://github.com/phoenixz810/mg-llava
공식 코드MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
MLLM Leaderboard
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning
From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation
On the Road with GPT-4V(ision): Early Explorations of Visual-Language Model on Autonomous Driving
Polymath: A Challenging Multi-modal Mathematical Reasoning Benchmark
Passage Retrieval for Outside-Knowledge Visual Question Answering
Generalizing from SIMPLE to HARD Visual Reasoning: Can We Mitigate Modality Imbalance in VLMs?
SpatialSense: An Adversarially Crowdsourced Benchmark for Spatial Relation Recognition
Point and Ask: Incorporating Pointing into Visual Question Answering
FEDMEKI: A Benchmark for Scaling Medical Foundation Models via Federated Knowledge Injection
Declarative Knowledge Distillation from Large Language Models for Visual Question Answering Datasets
MetaSpatial: Reinforcing 3D Spatial Reasoning in VLMs for the Metaverse
VQA$^2$: Visual Question Answering for Video Quality Assessment
NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenario
Cross-Modal Contrastive Learning for Robust Reasoning in VQA
Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyond
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
MedBLIP: Bootstrapping Language-Image Pre-training from 3D Medical Images and Texts
Investigating Prompting Techniques for Zero- and Few-Shot Visual Question Answering
Graphhopper: Multi-Hop Scene Graph Reasoning for Visual Question Answering
Pix2Shape: Towards Unsupervised Learning of 3D Scenes from Images using a View-based Representation
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understanding
InfiGUI-R1: Advancing Multimodal GUI Agents from Reactive Actors to Deliberative Reasoners
FortisAVQA and MAVEN: a Benchmark Dataset and Debiasing Framework for Robust Multimodal Reasoning
Look, Listen, and Answer: Overcoming Biases for Audio-Visual Question Answering
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.