Timezone: »

 
Poster
PerfectDou: Dominating DouDizhu with Perfect Information Distillation
Guan Yang · Minghuan Liu · Weijun Hong · Weinan Zhang · Fei Fang · Guangjun Zeng · Yue Lin

Wed Nov 30 02:00 PM -- 04:00 PM (PST) @ Hall J #800
in Poster Session 4 »

As a challenging multi-player card game, DouDizhu has recently drawn much attention for analyzing competition and collaboration in imperfect-information games. In this paper, we propose PerfectDou, a state-of-the-art Doudizhu AI system that summits the game, in an actor-critic framework with a proposed technique named perfect information distillation.In detail, we adopt a perfect-training-imperfection-execution framework that allows the agents to utilize the global information to guide the training of the policies as if it is a perfect information game and the trained policies can be used to play the imperfect information game during the actual gameplay. Correspondingly, we characterize card and game features for DouDizhu to represent the perfect and imperfect information. To train our system, we adopt proximal policy optimization with generalized advantage estimation in a parallel training paradigm. In experiments we show how and why PerfectDou beats all existing programs, and achieves state-of-the-art performance.

Keywords: Reinforcement Learning · poker games · game AI · card games
[ Paper]  [ Poster]  [ OpenReview] 

Author Information

Guan Yang (Netease Games AI Lab, Guangzhou)
Minghuan Liu (Shanghai Jiao Tong University)
Weijun Hong (Netease Games)
Weinan Zhang (Shanghai Jiao Tong University)
Fei Fang (Carnegie Mellon University)
Guangjun Zeng (Netease Games AI Lab, Guangzhou, China)
Yue Lin (Netease Games AI Lab)

More from the Same Authors