https://github.com/vectorinstitute/humanibench
공식 코드HumaniBench: A Human-Centric Framework for Large Multimodal Models Evaluation
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
MLLM Leaderboard
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
HumaniBench: A Human-Centric Framework for Large Multimodal Models Evaluation
Towards Vision-Language Mechanistic Interpretability: A Causal Tracing Tool for BLIP
MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Models
MiniGPT-Med: Large Language Model as a General Interface for Radiology Diagnosis
Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces
Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark
VTQA: Visual Text Question Answering via Entity Alignment and Cross-Media Reasoning
On The Planning Abilities of OpenAI's o1 Models: Feasibility, Optimality, and Generalizability
Large-scale Pretraining for Visual Dialog: A Simple State-of-the-Art Baseline
Fully Authentic Visual Question Answering Dataset from Online Communities
The Art of SOCRATIC QUESTIONING: Recursive Thinking with Large Language Models
A Question-Centric Model for Visual Question Answering in Medical Imaging
AutoBench-V: Can Large Vision-Language Models Benchmark Themselves?
InstructionGPT-4: A 200-Instruction Paradigm for Fine-Tuning MiniGPT-4
Structured Triplet Learning with POS-tag Guided Attention for Visual Question Answering
INF-LLaVA: Dual-perspective Perception for High-Resolution Multimodal Large Language Model
Enhancing Reasoning to Adapt Large Language Models for Domain-Specific Applications
Patho-R1: A Multimodal Reinforcement Learning-Based Pathology Expert Reasoner
Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Model
Plausible May Not Be Faithful: Probing Object Hallucination in Vision-Language Pre-training
SORNet: Spatial Object-Centric Representations for Sequential Manipulation
WinoGAViL: Gamified Association Benchmark to Challenge Vision-and-Language Models
Enhancing Vietnamese VQA through Curriculum Learning on Raw and Augmented Text Representations
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.