Evolution 6.0: Evolving Robotic Capabilities Through Generative Design
원문 초록
We propose a new concept, Evolution 6.0, which represents the evolution of robotics driven by Generative AI. When a robot lacks the necessary tools to accomplish a task requested by a human, it autonomously designs the required instruments and learns how to use them to achieve the goal. Evolution 6.0 is an autonomous robotic system powered by Vision-Language Models (VLMs), Vision-Language Action (VLA) models, and Text-to-3D generative models for tool design and task execution. The system comprises two key modules: the Tool Generation Module, which fabricates task-specific tools from visual and textual data, and the Action Generation Module, which converts natural language instructions into robotic actions. It integrates QwenVLM for environmental understanding, OpenVLA for task execution, and Llama-Mesh for 3D tool generation. Evaluation results demonstrate a 90% success rate for tool generation with a 10-second inference time, and action generation achieving 83.5% in physical and visual generalization, 70% in motion generalization, and 37% in semantic generalization. Future improvements will focus on bimanual manipulation, expanded task capabilities, and enhanced environmental interpretation to improve real-world adaptability.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Parallels Between VLA Model Post-Training and Human Motor Learning: Progress, Challenges, and Trends
WorldVLA: Towards Autoregressive Action World Model
AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics
Benchmarking Vision, Language, & Action Models on Robotic Learning Tasks
VLA-OS: Structuring and Dissecting Planning Representations and Paradigms in Vision-Language-Action Models
토론
이 논문과 연결된 포럼 글이 아직 없습니다.