A Sequential Quadratic Programming Approach to the Solution of Open-Loop Generalized Nash Equilibria
원문 초록
Dynamic games can be an effective approach to modeling interactive behavior between multiple non-cooperative agents and they provide a theoretical framework for simultaneous prediction and control in such scenarios. In this work, we propose a numerical method for the solution of local generalized Nash equilibria (GNE) for the class of open-loop general-sum dynamic games for agents with nonlinear dynamics and constraints. In particular, we formulate a sequential quadratic programming (SQP) approach which requires only the solution of a single convex quadratic program at each iteration. Central to the robustness of our approach is a non-monotonic line search method and a novel merit function for SQP step acceptance. We show that our method achieves linear convergence in the neighborhood of local GNE and we derive an update rule for the merit function which helps to improve convergence from a larger set of initial conditions. We demonstrate the effectiveness of the algorithm in the context of car racing, where we show up to 32\% improvement of success rate when comparing against a state-of-the-art solution approach for dynamic games. \url{https://github.com/zhu-edward/DGSQP}.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Perceptual Similarity for Measuring Decision-Making Style and Policy Diversity in Games
Contextualized Hybrid Ensemble Q-learning: Learning Fast with Control Priors
Stabilizing Unsupervised Environment Design with a Learned Adversary
Decision-making and control with diffractive optical networks
Iterative Linear Quadratic Optimization for Nonlinear Control: Differentiable Programming Algorithmic Templates
MicroRacer: a didactic environment for Deep Reinforcement Learning
토론
이 논문과 연결된 포럼 글이 아직 없습니다.