Learning to Solve Voxel Building Embodied Tasks from Pixels and Natural Language Instructions
원문 초록
The adoption of pre-trained language models to generate action plans for embodied agents is a promising research strategy. However, execution of instructions in real or simulated environments requires verification of the feasibility of actions as well as their relevance to the completion of a goal. We propose a new method that combines a language model and reinforcement learning for the task of building objects in a Minecraft-like environment according to the natural language instructions. Our method first generates a set of consistently achievable sub-goals from the instructions and then completes associated sub-tasks with a pre-trained RL policy. The proposed method formed the RL baseline at the IGLU 2022 competition.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
OctoThinker: Mid-training Incentivizes Reinforcement Learning Scaling
Inverse Reinforcement Learning Meets Large Language Model Post-Training: Basics, Advances, and Opportunities
VisionThink: Smart and Efficient Vision Language Model via Reinforcement Learning
Tactical Decision for Multi-UGV Confrontation with a Vision-Language Model-Based Commander
Squeeze the Soaked Sponge: Efficient Off-policy Reinforcement Finetuning for Large Language Model
AdapThink: Adaptive Thinking Preferences for Reasoning Language Model
토론
이 논문과 연결된 포럼 글이 아직 없습니다.