System III: Learning with Domain Knowledge for Safety Constraints
원문 초록
Reinforcement learning agents naturally learn from extensive exploration. Exploration is costly and can be unsafe in $\textit{safety-critical}$ domains. This paper proposes a novel framework for incorporating domain knowledge to help guide safe exploration and boost sample efficiency. Previous approaches impose constraints, such as regularisation parameters in neural networks, that rely on large sample sets and often are not suitable for safety-critical domains where agents should almost always avoid unsafe actions. In our approach, called $\textit{System III}$, which is inspired by psychologists' notions of the brain's $\textit{System I}$ and $\textit{System II}$, we represent domain expert knowledge of safety in form of first-order logic. We evaluate the satisfaction of these constraints via p-norms in state vector space. In our formulation, constraints are analogous to hazards, objects, and regions of state that have to be avoided during exploration. We evaluated the effectiveness of the proposed method on OpenAI's Gym and Safety-Gym environments. In all tasks, including classic Control and Safety Games, we show that our approach results in safer exploration and sample efficiency.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Confidence-Guided Human-AI Collaboration: Reinforcement Learning with Distributional Proxy Value Propagation for Autonomous Driving
ConRFT: A Reinforced Fine-tuning Method for VLA Models via Consistency Policy
Handling Long-Term Safety and Uncertainty in Safe Reinforcement Learning
Exterior Penalty Policy Optimization with Penalty Metric Network under Constraints
Safe Reinforcement Learning in Black-Box Environments via Adaptive Shielding
A comparison of RL-based and PID controllers for 6-DOF swimming robots: hybrid underwater object tracking
토론
이 논문과 연결된 포럼 글이 아직 없습니다.