Marginal Utility for Planning in Continuous or Large Discrete Action Spaces
원문 초록
Sample-based planning is a powerful family of algorithms for generating intelligent behavior from a model of the environment. Generating good candidate actions is critical to the success of sample-based planners, particularly in continuous or large action spaces. Typically, candidate action generation exhausts the action space, uses domain knowledge, or more recently, involves learning a stochastic policy to provide such search guidance. In this paper we explore explicitly learning a candidate action generator by optimizing a novel objective, marginal utility. The marginal utility of an action generator measures the increase in value of an action over previously generated actions. We validate our approach in both curling, a challenging stochastic domain with continuous state and action spaces, and a location game with a discrete but large action space. We show that a generator trained with the marginal utility objective outperforms hand-coded schemes built on substantial domain knowledge, trained stochastic policies, and other natural objectives for generating actions for sampled-based planners.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Parallels Between VLA Model Post-Training and Human Motor Learning: Progress, Challenges, and Trends
WorldVLA: Towards Autoregressive Action World Model
AutoVLA: A Vision-Language-Action Model for End-to-End Autonomous Driving with Adaptive Reasoning and Reinforcement Fine-Tuning
Time to Talk: LLM Agents for Asynchronous Group Communication in Mafia Games
STAR: Learning Diverse Robot Skill Abstractions through Rotation-Augmented Vector Quantization
OWMM-Agent: Open World Mobile Manipulation With Multi-modal Agentic Data Synthesis
토론
이 논문과 연결된 포럼 글이 아직 없습니다.