CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models
원문 초록
Vision-language-action models (VLAs) have shown potential in leveraging pretrained vision-language models and diverse robot demonstrations for learning generalizable sensorimotor control. While this paradigm effectively utilizes large-scale data from both robotic and non-robotic sources, current VLAs primarily focus on direct input--output mappings, lacking the intermediate reasoning steps crucial for complex manipulation tasks. As a result, existing VLAs lack temporal planning or reasoning capabilities. In this paper, we introduce a method that incorporates explicit visual chain-of-thought (CoT) reasoning into vision-language-action models (VLAs) by predicting future image frames autoregressively as visual goals before generating a short action sequence to achieve these goals. We introduce CoT-VLA, a state-of-the-art 7B VLA that can understand and generate visual and action tokens. Our experimental results demonstrate that CoT-VLA achieves strong performance, outperforming the state-of-the-art VLA model by 17% in real-world manipulation tasks and 6% in simulation benchmarks. Project website: https://cot-vla.github.io/
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Vision Language Action Models in Robotic Manipulation: A Systematic Review
VOTE: Vision-Language-Action Optimization with Trajectory Ensemble Voting
DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledge
A Survey on Vision-Language-Action Models for Autonomous Driving
Parallels Between VLA Model Post-Training and Human Motor Learning: Progress, Challenges, and Trends
WorldVLA: Towards Autoregressive Action World Model
토론
이 논문과 연결된 포럼 글이 아직 없습니다.