Taming "data-hungry" reinforcement learning? Stability in continuous state-action spaces
원문 초록
We introduce a novel framework for analyzing reinforcement learning (RL) in continuous state-action spaces, and use it to prove fast rates of convergence in both off-line and on-line settings. Our analysis highlights two key stability properties, relating to how changes in value functions and/or policies affect the Bellman operator and occupation measures. We argue that these properties are satisfied in many continuous state-action Markov decision processes, and demonstrate how they arise naturally when using linear function approximation methods. Our analysis offers fresh perspectives on the roles of pessimism and optimism in off-line and on-line RL, and highlights the connection between off-line RL and transfer learning.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Transfer Learning for Automated Test Case Prioritization Using XCSF
Margin Trader: A Reinforcement Learning Framework for Portfolio Management with Margin and Constraints
Energy Harvesting Reconfigurable Intelligent Surface for UAV Based on Robust Deep Reinforcement Learning
Multi-modal Siamese Network for Entity Alignment
Task Independent Capsule-Based Agents for Deep Q-Learning
CO-PILOT: COllaborative Planning and reInforcement Learning On sub-Task curriculum
토론
이 논문과 연결된 포럼 글이 아직 없습니다.