Learning to Communicate Using Counterfactual Reasoning
원문 초록
Learning to communicate in order to share state information is an active problem in the area of multi-agent reinforcement learning (MARL). The credit assignment problem, the non-stationarity of the communication environment and the creation of influenceable agents are major challenges within this research field which need to be overcome in order to learn a valid communication protocol. This paper introduces the novel multi-agent counterfactual communication learning (MACC) method which adapts counterfactual reasoning in order to overcome the credit assignment problem for communicating agents. Secondly, the non-stationarity of the communication environment while learning the communication Q-function is overcome by creating the communication Q-function using the action policy of the other agents and the Q-function of the action environment. Additionally, a social loss function is introduced in order to create influenceable agents which is required to learn a valid communication protocol. Our experiments show that MACC is able to outperform the state-of-the-art baselines in four different scenarios in the Particle environment.
함께 살펴볼 논문
공통 태그를 근거로 연결했습니다. 실제 인용 관계나 논문의 우수성을 뜻하지 않습니다.
Curriculum Learning With Counterfactual Group Relative Policy Advantage For Multi-Agent Reinforcement Learning
Diffusion Counterfactual Generation with Semantic Abduction
Counterfactual reasoning: an analysis of in-context emergence
Graph Style Transfer for Counterfactual Explainability
Causal Cartographer: From Mapping to Reasoning Over Counterfactual Worlds
Beyond the Known: Decision Making with Counterfactual Reasoning Decision Transformer
토론
이 논문과 연결된 포럼 글이 아직 없습니다.