Papers with Code 아카이브

Multimodal Reasoning

태스크의 하위 분류와 논문·코드·평가·기법·데이터셋을 탐색하세요.

전체 기법전체 데이터셋

하위 태스크

1

평가표

3

보존된 평가 기록

13

코드

관련 논문과 평가 결과에 연결된 구현입니다. 출처에서 확인된 저자 구현에는 공식 코드 표시가 있습니다.

https://github.com/declare-lab/llm-puzzletest

공식 코드

Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning

https://github.com/declare-lab/mm-bigbench

공식 코드

MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Tasks

https://github.com/declare-lab/puzzle-reasoning

공식 코드

Are Language Models Puzzle Prodigies? Algorithmic Puzzles Unveil Serious Challenges in Multimodal Reasoning

https://github.com/dingchenyang99/pensieve

공식 코드

Pensieve: Retrospect-then-Compare Mitigates Visual Hallucination

https://github.com/dmg-illc/trade

공식 코드

Don't Buy it! Reassessing the Ad Understanding Abilities of Contrastive Multimodal Models

https://github.com/doubtedsteam/dyvte

공식 코드

Accelerating Multimodal Large Language Models via Dynamic Visual-Token Exit and the Empirical Findings

https://github.com/dvlab-research/Lyra

공식 코드

Lyra: An Efficient and Speech-Centric Framework for Omni-Cognition

https://github.com/dvlab-research/prompt-highlighter

공식 코드

Prompt Highlighter: Interactive Control for Multi-Modal LLMs

https://github.com/eit-nlp/connector-selection-for-mllm

공식 코드

To Preserve or To Compress: An In-Depth Study of Connector Selection in Multimodal Large Language Models

https://github.com/embodiedcity/embodied-r.code

공식 코드

Embodied-R: Collaborative Framework for Activating Embodied Spatial Reasoning in Foundation Models via Reinforcement Learning

https://github.com/evolvinglmms-lab/longva

공식 코드

Long Context Transfer from Language to Vision

https://github.com/evolvinglmms-lab/mgpo

공식 코드

High-Resolution Visual Reasoning via Multi-Turn Grounding-Based Reinforcement Learning

https://github.com/facebookresearch/dual-system-for-visual-language-reasoning

공식 코드

DOMINO: A Dual-System for Multi-step Visual Language Reasoning

https://github.com/facebookresearch/mmf/tree/main/projects/unit

공식 코드

UniT: Multimodal Multitask Learning with a Unified Transformer

https://github.com/fdamken/decoding_multilingual_moral_preferences

공식 코드

Decoding Multilingual Moral Preferences: Unveiling LLM's Biases Through the Moral Machine Experiment

https://github.com/google-deepmind/neptune

공식 코드

Neptune: The Long Orbit to Benchmarking Long Video Understanding

https://github.com/google-research/google-research/tree/master/socraticmodels

공식 코드

Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language

https://github.com/google/haloquest

공식 코드

HaloQuest: A Visual Hallucination Dataset for Advancing Multimodal Reasoning

https://github.com/haozhezhao/mic

공식 코드

MMICL: Empowering Vision-language Model with Multi-Modal In-Context Learning

https://github.com/hewei2001/reachqa

공식 코드

Distill Visual Chart Reasoning Ability from LLMs to MLLMs

https://github.com/hitsz-tmg/awesome-large-multimodal-reasoning-models

공식 코드

Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models

https://github.com/hiyouga/easyr1

공식 코드

Advancing Multimodal Reasoning via Reinforcement Learning with Cold Start

https://github.com/hkbunlp/mr.harm-emnlp2023

공식 코드

Beneath the Surface: Unveiling Harmful Memes with Multimodal Reasoning Distilled from Large Language Models

https://github.com/hkust-nlp/guimid

공식 코드

Breaking the Data Barrier -- Building GUI Agents Through Task Generalization

https://github.com/hqhqaq/hint-grpo

공식 코드

Boosting MLLM Reasoning with Text-Debiased Hint-GRPO

https://github.com/humanmllm/humanomniv2

공식 코드

HumanOmniV2: From Understanding to Omni-Modal Reasoning with Context

https://github.com/hyn2028/llm-cxr

공식 코드

LLM-CXR: Instruction-Finetuned LLM for CXR Image Understanding and Generation

https://github.com/ibm/gcog

공식 코드

On the generalization capacity of neural networks during generic multimodal reasoning

https://github.com/internlm/internlm-xcomposer

공식 코드

InternLM-XComposer: A Vision-Language Large Model for Advanced Text-image Comprehension and Composition

https://github.com/jiangsongtao/vtprompt

공식 코드

Joint Visual and Text Prompting for Improved Object-Centric Perception with Multimodal Large Language Models

https://github.com/jianzhao-huang/lorehm

공식 코드

Towards Low-Resource Harmful Meme Detection with LMM Agents

https://github.com/jmhb0/microvqa

공식 코드

MicroVQA: A Multimodal Reasoning Benchmark for Microscopy-Based Scientific Research

https://github.com/journeybench/journeybench

공식 코드

JourneyBench: A Challenging One-Stop Vision-Language Understanding Benchmark of Generated Images

https://github.com/justairr/satori-r1

공식 코드

SATORI-R1: Incentivizing Multimodal Reasoning with Spatial Grounding and Verifiable Rewards

https://github.com/kakaobrain/honeybee

공식 코드

Honeybee: Locality-enhanced Projector for Multimodal LLM

https://github.com/kge-sun/mm-math

공식 코드

MM-MATH: Advancing Multimodal Math Evaluation with Process Evaluation and Fine-grained Classification

출처: Papers with Code · CC BY-SA 4.0. 아카이브 자료와 새로 수집한 논문은 별도로 관리합니다.