M2-Reasoning: Empowering MLLMs with Unified General and Spatial Reasoning
원문 초록
Recent advancements in Multimodal Large Language Models (MLLMs), particularly through Reinforcement Learning with Verifiable Rewards (RLVR), have significantly enhanced their reasoning abilities. However, a critical gap persists: these models struggle with dynamic spatial interactions, a capability essential for real-world applications. To bridge this gap, we introduce M2-Reasoning-7B, a model designed to excel in both general and spatial reasoning. Our approach integrates two key innovations: (1) a novel data pipeline that generates 294.2K high-quality data samples (168K for cold-start fine-tuning and 126.2K for RLVR), which feature logically coherent reasoning trajectories and have undergone comprehensive assessment; and (2) a dynamic multi-task training strategy with step-wise optimization to mitigate conflicts between data, and task-specific rewards for delivering tailored incentive signals. This combination of curated data and advanced training allows M2-Reasoning-7B to set a new state-of-the-art (SOTA) across 8 benchmarks, showcasing superior performance in both general and spatial reasoning domains.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Warehouse Spatial Question Answering with LLM Agent
Scaling RL to Long Videos
OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understanding
ImplicitQA: Going beyond frames towards Implicit Video Reasoning
3D-Aware Vision-Language Models Fine-Tuning with Geometric Distillation
Reinforcing Spatial Reasoning in Vision-Language Models with Interwoven Thinking and Visual Drawing
토론
이 논문과 연결된 포럼 글이 아직 없습니다.