Timezone: »

 
Spotlight
E-MAPP: Efficient Multi-Agent Reinforcement Learning with Parallel Program Guidance
Can Chang · Ni Mu · Jiajun Wu · Ling Pan · Huazhe Xu

Thu Dec 08 09:00 AM -- 11:00 AM (PST) @
in Lightning Talks 5A-3 »
A critical challenge in multi-agent reinforcement learning(MARL) is for multiple agents to efficiently accomplish complex, long-horizon tasks. The agents often have difficulties in cooperating on common goals, dividing complex tasks, and planning through several stages to make progress. We propose to address these challenges by guiding agents with programs designed for parallelization, since programs as a representation contain rich structural and semantic information, and are widely used as abstractions for long-horizon tasks. Specifically, we introduce Efficient Multi-Agent Reinforcement Learning with Parallel Program Guidance(E-MAPP), a novel framework that leverages parallel programs to guide multiple agents to efficiently accomplish goals that require planning over $10+$ stages. E-MAPP integrates the structural information from a parallel program, promotes the cooperative behaviors grounded in program semantics, and improves the time efficiency via a task allocator. We conduct extensive experiments on a series of challenging, long-horizon cooperative tasks in the Overcooked environment. Results show that E-MAPP outperforms strong baselines in terms of the completion rate, time efficiency, and zero-shot generalization ability by a large margin.
Keywords: multi-agent reinforcement learning · long-horizon tasks · program guided agents

Author Information

Can Chang (Tsinghua University, Tsinghua University)
Ni Mu (Southeast University)
Jiajun Wu (Stanford University)
Ling Pan (Montreal Institute for Learning Algorithms (MILA))
Huazhe Xu (Tsinghua University)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors