https://github.com/aidc-ai/parrot
Wings: Learning Multimodal LLMs without Text-only Forgetting
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
MLLM Leaderboard
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Wings: Learning Multimodal LLMs without Text-only Forgetting
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Dynamic Memory Networks for Visual and Textual Question Answering
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Benchmarking Multimodal Mathematical Reasoning with Explicit Visual Dependency
ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Tasks
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering
Visual Programming: Compositional visual reasoning without training
CoCa: Contrastive Captioners are Image-Text Foundation Models
Visual Question Answering: Datasets, Algorithms, and Future Challenges
Mitigating Hallucinations in Large Vision-Language Models via Summary-Guided Decoding
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Evaluating Object Hallucination in Large Vision-Language Models
Multi-modal Factorized Bilinear Pooling with Co-Attention Learning for Visual Question Answering
Multi-modal Factorized Bilinear Pooling with Co-Attention Learning for Visual Question Answering
CLEVR-Ref+: Diagnosing Visual Reasoning with Referring Expressions
Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual Grounding
Hierarchical Question-Image Co-Attention for Visual Question Answering
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization
MDETR -- Modulated Detection for End-to-End Multi-Modal Understanding
M3D: Advancing 3D Medical Image Analysis with Multi-Modal Large Language Models
Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolution
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.