https://github.com/hila-chefer/Transformer-MM-Explainability
공식 코드Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers
태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.
MLLM Leaderboard
관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.
Generic Attention-model Explainability for Interpreting Bi-Modal and Encoder-Decoder Transformers
A Comprehensive Evaluation of GPT-4V on Knowledge-Intensive Visual Question Answering
Uni-MoE: Scaling Unified Multimodal LLMs with Mixture of Experts
LOViS: Learning Orientation and Visual Signals for Vision and Language Navigation
NeSyCoCo: A Neuro-Symbolic Concept Composer for Compositional Generalization
Dense 2D-3D Indoor Prediction with Sound via Aligned Cross-Modal Distillation
Pano-AVQA: Grounded Audio-Visual Question Answering on 360$^\circ$ Videos
Reasoning-OCR: Can Large Multimodal Models Solve Complex Logical Reasoning Problems from OCR Cues?
Logical Closed Loop: Uncovering Object Hallucinations in Large Vision-Language Models
Uncovering Hidden Connections: Iterative Search and Reasoning for Video-grounded Dialog
Learning Representations of Sets through Optimized Permutations
StableLLaVA: Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data
iParaphrasing: Extracting Visually Grounded Paraphrases via an Image
MAP: Multimodal Uncertainty-Aware Vision-Language Pre-training Model
Seeing What You Miss: Vision-Language Pre-training with Semantic Completion Learning
Watch Out Your Album! On the Inadvertent Privacy Memorization in Multi-Modal Large Language Models
SURE-VQA: Systematic Understanding of Robustness Evaluation in Medical VQA Tasks
Inst-IT: Boosting Multimodal Instance Understanding via Explicit Visual Prompt Instruction Tuning
VL-InterpreT: An Interactive Visualization Tool for Interpreting Vision-Language Transformers
RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent
출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.