Timezone: »
Recently, model-based agents have achieved better performance than model-free ones using the same computational budget and training time in single-agent environments. However, due to the complexity of multi-agent systems, it is tough to learn the model of the environment. The significant compounding error may hinder the learning process when model-based methods are applied to multi-agent tasks. This paper proposes an implicit model-based multi-agent reinforcement learning method based on value decomposition methods. Under this method, agents can interact with the learned virtual environment and evaluate the current state value according to imagined future states in the latent space, making agents have the foresight. Our approach can be applied to any multi-agent value decomposition method. The experimental results show that our method improves the sample efficiency in different partially observable Markov decision process domains.
Author Information
Zhiwei Xu (Institute of Automation, Chinese Academy of Sciences)
dapeng li (Institute ofAutomation, Chinese Academy of Sciences School of Artificial Intelligence, University of Chinese Academy of Sciences)
Bin Zhang (Institute of automation, Chinese academy of science, Chinese Academy of Sciences)
Yuan Zhan (Institute of automation, Chinese academic of science)
Yunpeng Baiia (Institute of automation, Chinese academy of science, Chinese Academy of Sciences)
Guoliang Fan (Institute of automation, Chinese academy of science, Chinese Academy of Sciences)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Poster: Mingling Foresight with Imagination: Model-Based Cooperative Multi-Agent Reinforcement Learning »
Dates n/a. Room
More from the Same Authors
-
2023 Poster: Dual Self-Awareness Value Decomposition Framework without Individual Global Max for Cooperative MARL »
Zhiwei Xu · Bin Zhang · dapeng li · Guangchong Zhou · Zeren Zhang · Guoliang Fan -
2022 Spotlight: Lightning Talks 5A-2 »
Qiang LI · Zhiwei Xu · Jia-Qi Yang · Thai Hung Le · Haoxuan Qu · Yang Li · Artyom Sorokin · Peirong Zhang · Mira Finkelstein · Nitsan levy · Chung-Yiu Yau · dapeng li · Thommen Karimpanal George · De-Chuan Zhan · Nazar Buzun · Jiajia Jiang · Li Xu · Yichuan Mo · Yujun Cai · Yuliang Liu · Leonid Pugachev · Bin Zhang · Lucy Liu · Hoi-To Wai · Liangliang Shi · Majid Abdolshah · Yoav Kolumbus · Lin Geng Foo · Junchi Yan · Mikhail Burtsev · Lianwen Jin · Yuan Zhan · Dung Nguyen · David Parkes · Yunpeng Baiia · Jun Liu · Kien Do · Guoliang Fan · Jeffrey S Rosenschein · Sunil Gupta · Sarah Keren · Svetha Venkatesh